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SUMMARY 

The teaching of modern foreign languages in American 
secondary schools has undergone two major changes in the past 
decade, new directions in classroom teaching strategy and the 
widespread introduction of the language laboratory. Both have 
been shown to be effective in small-scale controlled situations. 
The Pennsylvania Foreign Language Research Project was an at- 
tempt to assess the effectiveness of various teaching strategies 
and language laboratory types in the environment of the real 
school situation. 

Funded under Title VII-A of the National Defense Education 
Act, a large scale experiment was conducted in 104 Pennsylvania 
secondary schools of all types and diverse geographic and socio- 
economic areas. Sixty-one French I and forty-three German I 
classes were assigned to one of seven possible teaching strategy 
language laboratory combinations: "traditional,” "functional 

skills" or "functional-skills + grammar" with tape recorders, 
audio-active laboratories and audio-record laboratories. Class 
assignment was random across functional skills and laboratory 
treatment. 

For the purposes of the research study, definitions of 
’’traditional," "functional skills" and "functional-skills + 
grammar" strategies were defined by a selected group of foreign 
language educators whic. included Robert Lado, Stanley Sapon, 
Wilmarth Starr, W. Freeman Twaddell, Albert Valdman and Donald 
Walsh. Other prominent specialists assisted in various phases 
of the study. Rebecca Valette contributed by writing a foreign 
language Listening Discrimination and Sound Production Test for 
the Project. 

Thirty-five pre-experimental, first year and final measures 
were obtained on 1,090 students from sixty-seven French and Germ 
classes over a two-year period. Almost seven hundred students 
completed a one-year replication. In addition, randomly selecte 
samples were given additional skills tests. Over two hundred 
students were personally interviewed to determine student at- 
titudes and expectations. 

Major objectives and conclusions of the experiment after tw 
years of instruction and an adequate replication included: 

1. To determine which teaching strategy among the traditio 
audio-linguf;l or modified audio-lingual approaches best ac- 
complishes the four objectives of the foreign language program 1 
the secondary school - listening comprehension, speaking fluency 
reading and writing. 

Conclusion : No significant differences existed among strat 

egies on all skills except reading ( TLM > ) as measured on con- 
temporary standardized tests after two years. "Traditional 
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classes had achieved significantly higher on 1939-41 measures 
of reading, grammar and writing by the end of Level I. 

2. To determine which language laboratory system is most 

effective. 

Conclusion : The language laboratory of any type, used twice 

weekly, had no discemable effect on achievement. 

3* To determine the best predictors of success in foreign 
language achievement. 

Conclusion : The best over-all predictors of success are 

prior academic success and a modem language aptitude test. 

4. To identify student attitudes toward foreign language 
instruction. 

Conclusion ? Student opinion of foreign language study 
declines throughout the instruction, independent of the teaching 

strategy employed. 

5. To ascertain levels of language mastery. 

Conclusion : Published test "norms" and implied in text 

layout progress were more than most of the experimental 
population achieved. 

6. To identify strengths and weaknesses of selected 
commercial texts. 

Conclusion : Within the functional skills strategies stu- 

dents utilizing Holt, Rinehart and Winston materials did signifi- 
cantly better than students using the Audio -Lingual Materials . 

?• To identify teacher factors related to student 

achievement • 

Conclusion : Neither teacher experience in years and 

f raduate education nor scores on the MLA Teacher Proficiency 
g£t£ are related to mean class achievement after either one 

or two years. 

The study is continuing with the examination of student 
progress over an extended three and four year sequence. 
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A COMPARISON OF THE EFFECTIVENESS OF THE 
TRADITIONAL AND AUDIO-LINGUAL APPROACHES TO FOREIGN 
LANGUAGE INSTRUCTION UTILIZING LABORATORY EQUIPMENT 

SECTION I - INTRODUCTION 



The role of modern foreign language instruction in the 
American educational process has assumed major importance 
in recent years. Long a major segment of the curriculum, 
the improvement of modern foreign language instruction at 
all levels has become ”in the national interest.” 

The Commonwealth of Pennsylvania has long been committed 
to the teaching of foreign languages in the public schools. 

Ample testimony to this commitment is illustrated by the fact 
that hundreds of language laboratories are installed in its 
public schools and twenty percent of the teachers of foreign 
languages have attended NDEA summer institutes. Student 
enrollment in foreign language courses varies between seven- 
teen and twenty percent of the secondary school population. 

In support of the foreign language program the State has man- 
dated, ”...a minimum of a four-year sequence of a modern foreign 
language shall be offered by each school system” and requires 
for certification in the teaching of foreign languages that 
prospective candidates receive passable scores on the MLA 
Foreign Language Proficiency Test for Teachers and Advanced 
Students (Educational Testing Service, 1962). 

Implicit in this strong state support for the teaching 
of languages is the responsibility to provide expert advice 
on teaching methodology, ultimately determining the effective- 
ness of the language program. Yet, recent attacks on the 
purported usefulness of the language laboratory have been 
instrumental in raising doubts in the minds cf both profes- 
sional educators and interested lay nersons previously convinced 
of its effectiveness (Hocking, 1968). It is indeed surprising 
that, aside from extensive authoritative statements on the 
subject, there is little empirical research that can be cited 
as an effective rebuttal to these challenges. It was there- 
fore important that the profession initiate a study for re- 
solving several, basic problems related to secondary school 
foreign language instruction. 

The purpose of this research was to determine the most 
effective way of integrating the language laboratory into one 
or more of several alternative teaching strategies. It pro- 
posed to investigate this problem as it relates to foreign 
language teaching programs commonly found in the public secon- 
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dary school classroom. Present plans are to follow the parti- 
cipating students for the four years that they study the 
foreign language. However, the first phase of the research 
reported herein concerned Itself with evaluating only the first 
and second years of Instruction. 

Although this research was conducted within the Common- 
wealth of Pennsylvania, the area of the Departments juris- 
diction, there can be little doubt that the results will be 
applicable to many schools throughout the nation. This was 
assured by utilizing schools that were socio-economically 
representative and by minimizing the degree to which typical 
teaching conditions were to be modified. Also, the in- 
structional and testing materials were those commonly used in 
the teaching of foreign languages in the secondary schools. 



BACKGROUND OF THE PROBLEM 



Essentially, the profession is confronted with two re- 
lated questions: (1) Given several alternative teaching ap- 

proaches to foreign language instruction which of these is 
better? and (2) Which of the commonly used language laboratory 
systems is most effective as an adjunct to foreign language 
instruction? 

On the one hand, there is the historically older, and 
more widely practiced approach to foreign language instruction 
known as "grammar-translation” or "traditional." In oppo&.tlon 
to this there is developing increasingly wide support for the 
audiolingual" or "functional skills" approach, the origins of 
which extend as far back as the seventeenth century. Cur- 
rently, it is receiving its greatest support from findings in 
linguistic science. The proponents of these two schools are 
in disagreement on basic assumptions regarding the nature of 
language learning and different priorities in selecting foreign 
language objectives. Each advances a distinct set of methods 
designed to achieve the terminal language behaviors each deems 
most important. 

It must be emphasized that the terminal behaviors expected 
of these two approaches to foreign language learning are indeed 
distinct. This dichotomy is reflected in the basic design, the 

procedures, and the testing program of this research investi*- ' 
gat ion. 

The primary objective of the "Traditional" approach is 
mastery of the foreign language's syntax and vocabulary. Stu- 
dents are expected to memorize the written forms of words, 
paradigms, and rules of grammar and to use these to solve 
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linguistic puzzles in the form of English sentences to be 
translated into the foreign language. Conversational in- 
struction, when offered, is normally placed at the end of a 
three year sequence (Malecot, i960). Carroll (1965) suggests 
that this method is based on a: 

...modified, up-to-date grammar-translation theory. 
According to this theory, learning a language is a pro- 
cess of acquiring conscious control of the phonological, 
grammatical, and lexical patterns of a second language, 
largely through study and analyses of these patterns as 
a body of knowledge. The theory attaches more importance 
to the learner's understanding of the structure of the 
foreign language than to his facility in using that 
structure, since it is believed that, provided the student 
has a proper degree of cognitive control over the struc- 
tures of the language, facility will develop automatically 
with use of the language in meaningful situations. 

The "Functional Skills" approach finds its strongest pro- 
ponent in Brooks (1961). The organization of the language 
program is guided by the following tenets: 

The learner's activities must at first be confined 
to the audio-lingual and the gestural-visual bands of 
language behavior; only later will he become active in 
the visual band... From the start the learner plays a dual 
role in language, first as hearer, then as speaker. Only 
when he is thoroughly familiar with sounds, arrangements, 
and forms does he center his attention on enlarging his 
vocabulary. In learning the control of structure, what 
he may at first do as a matter of conscious choice, he 
will eventually do habitually and unconsciously. . .The 
memorization of work lists, lexical equivalents, and 
paradigms plays no part whatever in his early tasks. 

Traditionally, foreign language instruction stresses 
student mastery of the formal grammar of the target language. 
This emphasis on grammar can be traced to the influence of 
eighteenth-century grammarians who "assumed the existence of 
a universal grammar founded in universal reason and embodied 
in its purest state in the Greek and Latin of classical 
literature" (Guth, 1964). The textbook, consisting of care- 
fully graded reading selections and accompanying grammar 
lessons is the traditionalist's essential pedagogical tool. 

The assumption is that proficiency in the language can be 
acquired by learning a set of grammatical rules to which the 
language is supposed to conform and by mechanically applying 
these rules. Coleman's (1929) study, which has had wide 
influence on the teaching of foreign languages in the secon- 
dary schools, recommended the single objective of developing 
reading proficiency as being realistically attainable under 
typical classroom conditions. That oral mastery has never 
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been a serious expectation of the foreign language program 
is clearly demonstrated by the almost exclusive use of paper- 
pencil tests to evaluate student progress in language mastery. 

While, as earlier pointed out, the "audiolingual" em- 
phasis in modern foreign language teaching has roots extending 
back many years, the recent dramatic changes in the approach 
to foreign language instruction are, in no small measure, 
due to the findings of linguistic science during the past 30 
years. Johnston and Seerley (1961) note several linguistic 
propositions that have immediate implications for the high 
school language program. "Language is speech. The written 
form comes later, considerably later in the progression of 
language learning which is first hearing and speaking and then 
reading and writing." In sharp contrast to the formalistic 
traditional teaching methods, many linguists claim that lan- 
guage learning is a behavioral skill and not an intellectual 
discipline. Developing this skill, like any other, requires 
the careful cultivation of language habits that are an auto- 
matic, almost unconscious, performance of highly complicated 
physical and mental processes. Comprehension and accurate 
reproduction of the sounds of a language, which are the major 
objectives of the audiolingual approach, can only be achieved 
by imitating a native speaker or one who has mastered the 
native accent. 

Instead of sole reliance on the textbook, the audio- 
lingual teacher employs a set of teaching techniques and 
materials specifically designed to develop oral and listen- 
ing facility. For example, the "dialogue" father than the 
reading selection, is the primary instructional tool for the 
beginning student. A dialogue is a recorded conversation 
focusing on a real situation which the student can under- 
stand, identify with, and enjoy. Its language is the stan- 
dard, authentic, and contemporary informal language that 
would be used in equivalent circumstances by native speakers 
of the same age as the American students in the class. After 
extensive practice, using such recently devised techniques 
as modeling, full- and part-choral repetition with build-ups, 
double repetitions, and constant correction, each student 
is expected to master the complete dialogue. Mastery im- 
plies that the student be able to respond automatically with 
appropriate selections from the dialogue. Unlike the 
traditional program, the audiolingual program assesses stu- 
dent proficiency in the listening and oral skills in addition 
to testing reading and writing proficiency. 

The emphasis on imitation, practice and repetition to 
the point of "over-learning" encouraged many schools that 
adopted the audiolingual approach to install language labora- 
tory facilities. The usual classroom setting of 30 students 
per instructor 3 s wholly inadequate if the recommended 15-20 
minutes of daily oral practice is to be followed. In the 
laboratory, each student is able to practice individually 



without disturbing other students. In addition, Hayes (1963) 
notes that the language laboratory provides native models of 
the foreign language for imitation, extensive structure drills, 
a variety of native voices necessary for understanding the 
language in its natural setting, and facilities for testing 
each student for listening and speaking ability. 

A practical pedagogical purpose served by including a 
formal grammatical analysis is that of sustaining student 
interest. Constant practice and drill with new, and sometimes 
meaningless, drills would conceivably result in boredom, 
especially in the case of the bright student who naturally 
seeks the "why” to grammatical forms he is learning. 

Resolving these issues is important because the current 
ferment in foreign language instruction represents a major 
curricular change comparable to the revisions that the secon- 
dary school science and mathematics programs have undergone. 
Furthermore, discarding older programs and investing in audio- 
lingual materials and laboratory equipment is a financial 
investment of significant proportions. Careful study and 
deliberate evaluation should be important factors of any 
decision for change. 



PURPOSES AND OBJECTIVES 



The two broad areas of concern in this investigation were 
determining (l) the effects of the audiolingual approach upon 
student achievement in the learning of a second language, and 
(2) the type of language laboratory equipment that is most 
efficient in achieving the goals of the audiolingual program. 
The study also gathered information related to student 
achievement in each of the four language skills and the at- 
titudes associated with each of the experimental treatments. 

The purpose of a two or three year study was to provide 
longitudinal data on language learning in the setting of the 
secondary school. Education, in general, and mastery of a 
second language, in particular, are longitudinal processes; 
the appropriate manner in which they are to be studied should 
be longitudinal. Often, initially dramatic results favoring 
Method A or Procedure B prove premature when assessments are 
made over a long period of time. 

Carroll ( 1965 )* in a recent article, offers several rea- 
sons for the dearth of the type of research that is herein 
reported. Having presented the two major theories of language 
learning, i.e., the audio-lingual habit and the cognitive 
code-learning, he suggests that there is need for more infor- 
mation "on which of these theories is a better basis for for- 
eign language teaching." He states: 



At this point the would-be researcher has an impor- 
tant strategy decision to make. One course open to him 
is to conduct a large scale educational experiment in 
which the results of teaching based on the audio-lingual 
habit theory are contrasted with teaching based on the 
cognitive code-learning theory. This kind of research is 
feasible, but very expensive and difficult to control. 

The experimental design would call for some method for 
assuring that the students taught under the two theories 
are approximately equal in ability and motivation; 
ideally, students would be randomly assigned to the two 
methods, but educational realities may make this im- 
possible. Separate and distinct courses and materials 
of instruction must be created, and the instructors must 
be trained to adhere closely to a certain style of 
presentation. 

Of particular significance was Carroll's earlier (1963) 
advice: 



It may be recommended that useful experiments in 
foreign languages can be conducted by adhering fairly 
closely... to patterns of teaching and types of teaching 
materials which have already been developed and found 
necessary by foreign language teachers. 



FOREIGN LANGUAGE LABORATORY SYSTEMS 



The term "laboratory” refers to "a classroom or other 
area containing electronic and mechanical equipment designed 
and arranged to make foreign- language learning more effective 
than is usually possible without it," Hayes, T1963K Included 
in this definition are classrooms with only one tape-recorder, 
those with audio-active equipment, and laboratories fully 
equipped with audio-active-record facilities. Each of these 
systems is now briefly described. 

System Is Tape Recorder 

One or more tape recorders are used as program sources of 
recorded sound. This facility can be used by the student to 
practice listening skills and, in a limited way, to practice 
oral drills. However, he cannot control the equipment to pro- 
vide needed repetitions, nor can he hear native sounds with 
true fidelity. 

System II: Listen-Respond; Audio-Active 

In addition to the program sources and equipment included 
in System I, this system provides microphones for amplification. 
It is claimed that listening to his own voice through the 
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headset allows the student to correct errors when he Is In 
disagreement with the master's performance. If repeated he 
will be able to approximate closely the model by successive 
attempts. 

System III: Llsten-Respond-Compare ; Audio-Active-Record 

The addition of separate recording facilities in this 
system is a major improvement according to some language ed- 
ucators. Principally the student can record and then compare 
his responses directly with the model, different learning 
rates can be accomodated, and a practical method for evalu- 
ating speaking ability is thus provided. 

System I because of obvious economy and elimination of 
difficult scheduling problems was worth exploring as to its 
assets and liabilities- Experience and good judgment suggest 
that, funds permitting; individual student stations with 
headphones be considered to provide privacy, increased fi- 
delity, and the other advantages discussed above. 

In choosing between Systems II and III the profession is 
in fundamental disagreement. Locke (i960) is convinced that 
playback facilities are essential to pronunciation and struc- 
tural mastery. "Listening facilities or audio-active earphones 
will help by presenting him a model. The earphones. .. since 
they merely transmit the air-borne component of the sounds, 
they make no contribution whatever to helping the student in 
his really important and difficult job of eliminating the 
short circuit that prevents objectivity towards his speech 
production." Hartsook (i960) states, "I should like to go on 
record as being against the use of student recording in the 
foreign language laboratory...” In addition to the contention 
that student recording and playback tends to reinforce mis- 
takes, is boring, and does not materially improve self-evalu- 
ation, he reports that experience has shown it too is inef- 
ficient and in certain situations hampers progress. 

Establishing a foreign language program involves both 
adopting one of the several teaching strategies as well as 
selecting one of the basic systems. With the exception of 
the strictly traditional approach, one might pair any of the 
strategies with any one of the three laboratory facilities, 
six alternatives in all, and feel confident that there is 
both reason and authority to support this choice. 



RELATED RESEARCH 



In surveying the enormous research literature of foreign 
language teaching it was decided to omit references to studies 
which, while pertinent to any investigation of language in- 
struction, do not relate directly to the specific experimental 




- 7 - 



variables of this proposal. Reference citations are further 
limited to those which have relevance to language instruction 
at the secondary school level. 

Coleman (1929) in an extensive survey of foreign lan- 
guage teaching practices found conditions chaotic. Little or 
no evidence was discovered to support widely accepted practices 
and his report emphasized the need for evaluating the effects 
of the various practices under typical American classroom con- 
ditions. The Army Specialized Training Program (A.S.T.P.) was 
developed with the assistance of linguistic scientists, and is 
considered by many to be the precursor of the current audio- 
lingual trend. Birkmaier (I9o0) reports that a completely 
objective evaluation of the Army program was never made. 

Scheuler (1944) doubted that reading mastery could best 
be obtained by means of the aural-oral methods employed by 
the"' A.S.T.P. Carroll (1963) reports, 

Proponents of ’new-type* courses which initially em- 
phasize audiolingual skills claim, however, that read- 
ing skills will be more fluent and facile when the 
teaching or reading is delayed until the student has 
achieved a certain degree of mastery of audiolingual 
".skills. There* is-no. rebeircsh. infdrmatlonv vhowelrer , to 
indicate whether this claim is sound or how long the 
teaching or reading should be delayed. 

Following widespread interest in the A.S.T.P. and adop- 
tion of its techniques the Rockefeller Foundation supported a 
broad survey of the teaching of a second language. Agard and 
Dunkel (1948) conducted the study and reported that (l) few 
students in the aural-oral programs were able to attain 
"spontaneously fluent speech in one or two years time and that 
(2) the experimental groups had consistently superior pro- 
nunciation compared to conventional groups but lagged in read- 
ing proficiency. 

Although Carroll (1963) found "much of value in this 
study," he describes it as deficient in "exact controls and 
rigorous experimental design. " 

Most of the efforts following the Agard -Dunkel (1948) 
study consisted of materials development for audiolingual in- 
struction. Lacking instructional materials, standardized tests 
to evaluate listening and speaking achievement, and adequate 
laboratory facilities to accomodate the new program demands, 
little useful research comparing new and conventional programs 
was possible (Birkmaier, i960). Carroll (1963) dismisses most 
of the available studies as being "poorly controlled or other- 
wise deficient from the standpoint of valid research methodology. 

Pickrel, Neidt, and Gibson (1958) demonstrated the value 
of tape recordings in junior high school Spanish classes. Buch 
(1963) compared the effectiveness of four different language 
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laboratory arrangements in beginning French. He reports that 
the overall best results on conventional and audiolingual 
tests were achieved by the group that spent eighty percent of 
their laboratory time with audio-active equipment and 
twenty percent of the time with the record facilities. Al- 
though meticulous care was taken to develop reliable, un- 
biased, and accurate judge ratings of the audiolingual skills 
the investigators note several weaknesses in the design which 
limit generalizing the results. Each experimental treatment 

was administered to only one class, only one teacher was in- 
volved, students were evaluated during the first year only, 
and the materials were not those normally intended for an 
audiolingual program. 

A study that has attracted considerable interest in 
foreign language teaching circles was conducted by Keating 
(1963). About 5,000 students from 21 school districts par- 
ticipated representing French Levels, I, II, III, and IV. 

For the three skills tested — reading comprehension, listening 
comprehension, and speech production — significant differences 
favored the no-laboratory group in nearly all cases. However, 
a careful reading of this study raises serious doubts regarding 
the validity of the research and the generalization of these 
results to other foreign language teaching situations. 

Mr. Keating noted on page 24 of his report, "...this study 
cannot be considered an experiment in any proper sense ... since 
all the students tested were involved in on-going programs.” 

As if to emphasize the research design limitations the following 
quotation from page 38 is instructive, "...absolutely no pro- 
vision was made for central control of any kind over the 
independent districts." 

The Bureau of Audio-Visual Instruction, Board of Edu- 
cation of the City of New York (1963) reported on two re- 
lated studies which are to date the most careful and exten- 
sive studies on the effectiveness of the language laboratory 
in high school. The first "proposed to test measurable im- 
provement in competence in speaking French and in comprehen- 
sion of spoken French without significant loss in reading 
comprehension and in written aspects of language study." 
Significant gains were made by the laboratory groups in 
speech and listening skills without loss in traditional 
skills as measured by a standardized French test. 

The second of these studies was concerned with the rel- 
ative effectiveness of three types of language laboratory 
experiences. Essentially, one group used recording equipment 
daily, another used only nonrecording equipment daily, and the 
third group used recording and nonrecording equipment. 
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In the global rating (overall quality) of speech, the 
Record-Playback-Daily group showed the greatest gain. . . 
and all experimental groups gained more than the control 
group in global rating of speech... In no measure did 
the control (traditional) group make gains significantly 
greater than all lab groups, whereas, the Record- 
Playback-Daily group stands first or second in thirteen'^ 
out of fourteen measures. 

Here again the instructional methods, materials, and 
evaluation instruments were "transitional" and the number of 
both pupils and teachers is insufficient to permit a defini- 
tive conclusion based on the findings. 

The most extensively reported research on comparing the 
two teaching strategies, "traditional" and "audiolingual" or 
"functional skills, is that of Scherer and Wertheimer (1964). 
The Scherer-Wertheimer study showed that, at the end of two 
years of college instruction, students who had a first-year 
audiolingual background did better in listening and speaking 
but were equal to or worse than traditional students in read- 
ing, writing, and translation. Evaluation of the investi- 
gation depended to a great degree upon correlations and the 
direct comparison of the means of the two groups. This study, 
while a classic, contained some factors which the present 
investigation was determined to avoid. Among these were (l) 
a research population consisting of college students of one 
language only, (2) the creation of special teaching materials, 
(3) the small number of students completing the two-year study 
(N=49) and (4) the inability of the investigators to maintain 
the spearation of the two groups under investigation. 

In 1964 the School District of Philadelphia undertook a 
nineteen school assessment of "traditional" and "audio- 
lingual" approaches in French and Spanish utilizing only the 
text as the instructional variable. (Sandstrom and Rofman, 
1967) Each school had both audiolingual and traditional clas- 
ses assigned. Numerous meetings and workshops were held to 
minimize variability due to teacher individual differences. 

The criteria vaxiables of the experiment were (l) teacher 
rating of student performance and (2) the MLA Cooperative 
Classroom Tests in Listening and Reading administered at the 
end of the two-year period of instruction. No pre-experi- 
mental measures are reported. Speaking and W-rltlng tests 
were administered but not used due to the small sample tested. 
While no statistical data is reported, the study concluded 
that the students in audio-lingual classes performed better 
than "control" (traditional) students on evaluative criteria. 

More recently the effectiveness and value of the language 
laboratory has again been questioned. In his nation-wide 
study on the foreign language proficiency of college majors 
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Carroll (1966) observed that students who reported a language 
laboratory experience did not seem to achieve better than 
students who had not had such experience. One of the natian*s 
leading school consultant firms, Engelhardt, Engelhardt ana 
Leggett, is advising educational planners that language labora- 
tories do not seem to do an adequate job for "Che money in- 
vested. Hocking (1967) reports the disillusionment of a typical 
foreign language educator with the language laboratory in his 
school system. 

By 1964 no sufficiently realistic and generalizable re- 
search had been undertaken to shed light on specific questions 
on modem foreign language instruction facing the American 
secondary school: which strategy or laboratory system works 

best when translated from a specific local small scale set- 
ting into the larger reality of numerous secondary schools” 

To assist in developing answers to this question, the Common- 
wealth of Pennsylvania undertook the large-scale in g^tu 
experiment which has come to be known as "Project 1330 > v later 
officially as No. 5-0683), An Assessment of Three Language 
Laboratory Systems.” The investigation has been reported in 
detail (Smith and Berger, 1968) and will be oited often ln w 
the remainder of this document. A portion of the Summary 
of the first year report is reproduced here for the convenience 

of the reader. 
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SUMMARY, FIRST YEAR 



The Pennsylvania Foreign Language Research Project was an 
attempt to determine the effectiveness of various teaching 
strategies and language laboratories in the environment of 
the real school situation. Funded under Title VII-A of the 
National Defense Education Act, a large scale experiment was 
conducted in 104 Pennsylvania secondary schools of all types 
and diverse geographic and socio-economic areas. Sixty-one 
French I and forty- three German I classes were assigned to one 
of seven possible teaching strategy-language laboratory com- 
binations: "traditional,” "functional skills" or "functional- 

skills + grammar" with tape recorders, audio-active laboratories 
and audio-record laboratories. Class assignment was random 
across functional skills and laboratory treatment. 

Students and teachers were given extensive pre-testing, 
mid-year end post-testing. Twenty-five discrete measures 
and twelve attitude-opinion indices were obtained on 2,171 
students. Three hundred students received additional tests 
of speaking and writing. Data analysis was based upon cor- 
relation and analyses of variance, covariance and regression. 

For the major portion the class/group mean was used as the 
statistical unit for analysis. 

Important conclusions at the end of one year of experi- 
mentation Included: 

1. "Traditional" students exceeded or equalled "Functional 
Skills" students on all measures; 

2. The language laboratory systems as employed twice 
weekly had no discernable effect; 

3. There was no "optimum" combination of strategy and 

system; 

4. The best combination of predictors of success were 
the MLA Cooperative Classroom Listening Test . the Modern 
Language Aptitude Test and Language I.Q. as measured by the 
California Test of Mental Maturity (Short Form). 

5. Females achieved better than males; 

6. Student attitude was independent of the strategy em- 
ployed ; 

7. "Functional Skills" classes proceeded more slowly 
than "Traditional" classes; and 

8. There was no relationship between teacher scores on 
all seven portions of the MLA Teacher Proficiency Tests and the 
achievement of their classes in foreign language skills... 
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CONTINUATION OF THE INVESTIGATION 



The major effort of the second year of the study was 
directed toward assessing student achievement during the 
second year of instruction. There are distinctive features 
that characterize the second year of an audio-lingual foreign 
language program. These result from the philosophy regarding 
the nature of language which has had a marked influence on the 
recommended instructional methods. For example, one publisher 
introduces his approach to the teaching of reading skills with 
the statement: 

...Level One makes a careful distinction between two 
kinds of reading: (l) reading in the sense of pronoun- 

cing words and sentences aloud in response to the stimulus 
of a printed or written sentence, and (2) reading for 
comprehension. Level Two is concerned with the develop- 
ment of the second type of reading. Its aim is to de- 
velop the’ ability. v. td read with understanding without 
translating. (Harcourt, Brace & World, Inc.) 

Similarly, there are differences that distinguish the 
teaching of grammar developing listening and speaking skills, 
and the. instruction in writing at the two levels. One impor- 
tant purpose of the second year study was, then, to assess 
stud-ent, achievement in mastery of those skills that are taught 
at Level Two. Specific Objectives of the second year of the 
experiment were narrowed to concentrate primarily on the 
major objectives of the original proposal. 



SPECIFIC OBJECTIVES OF THE RESEARCH 



1. To determine which of three foreign language teach- 
ing strategies is most effective in achieving each of the 
four foreign language objectives, i.e. listening comprehen- 
sion, speaking fluency, reading, and writing (main effects). 

2. To determine which of three language laboratory 
systems is best suited, economically and instructionally , to 
the development of pronunciation and structural accuracy 
(main effects). 

3. To determine which variable, or combination of vari- 
ables - IQ, total grade point average, and appropriate prog- 
nostic test - best predicts student achievement in foreign 
languages in each of the four foreign language skills and in 
overall language mastery. 
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4. ' To identify and compare student attitudes toward each 
of the teaching strategies and language laboratory systems. 

5. To identify levels of foreign language mastery that 
are attainable in the secondary school language program. 

6. To determine the strengths and weaknesses of selec- 
ted commercial programs; and 

7 J To identify teacher factors related to student 
achievement • 

In order to investigate these specific objectives, Project 
7-0133 > "A Comparison..." was undertaken as an extension of 
and replication to Project 5-0683 in September, 1966. 



SECTION II - METHOD 



PART I - THE EXPERIMENTAL DESIGN AND CONTROLS 



The basic design of any experiment is, of course, de- 
termined by the specific objectives of the study with the 
concomitant influences of the environment and evaluative 
techniques. Initially conceived by Emanuel Berger, Research 
Associate, Bureau of Research, Department of Public Instruc- 
tion, the research schematic was further refined by a number 
of persons involved in the early stages of the Project. Among 
these were Dr. N. Sidney Archer of the Bureau of Research, 
Department of Public Instruction; Dr. Robert W, Cannaday, Jr., 
then Modem Foreign Language Coordinator for the Bureau of 
General and Academic Education, Department of Public Instruc- 
tion; Dr. Alfred D. Roberts, Chairman of the Department of 
Foreign Languages, and Dr. Milton C. Woodlen, Director of 
Research, both at West Chester State College. 



RATIONALE FOR THE EXPERIMENTAL DESIGN 



Discussions among these men and others resulted in the 
establishment of proposed guidelines and objectives within 
which framework the actual experimental design had to func- 
tion. The proposed research, by incorporating a number of 
factors apparently overlooked in studies reported earlier, 
attempted to preclude some of the criticisms of research 
studies noted in the preceding section. Specifically, it was 
planned to more effectively reduce unwanted variability in 
teacher behavior by (l) utilizing large numbers of teachers; 

(2) teacher testing; (3) employment of teachers within certain 
experience parameters; (4) teacher orientation and training; 
and (5) frequent observation of classroom behavior. Random- 
ization of confounding factors was attempted by including large 
numbers of classes and students from many broadly representative 
schools. 

Generality of findings was thought to be increased by use 
of materials and testing instruments of a type widely used and 
readily available to all schools. Statistical methods used in 
evaluation were to be as thorough as the experimental design 
permitted. 

A need was felt to include a "middle-of-the-road” approach 
between the "traditional" and the "functional skills" approaches. 
This reflected the thinking of a considerable segment of the 
modern foreign language teaching profession and is evident in 
the literature, particularly in the approaches advocated by 
Rivers (1964), Carroll (1964), and Belyayev (1964). 



Accordingly, three teaching strategies were envisioned: 
the traditional method (TLM), the functional skills method 
(FSM), and a combination of functional skills plus exposure 
to formal grammar (FSG), In the same light, the three most 
widely used electro-mechanical aids needed to be included, 
the classroom tape recorder (TR), the listen-respond or 
audio-active (AA; language laboratory or electronic classroom 
and the audio-record (AR) language laboratory. 



ABBREVIATIONS 



To facilitate reading of the accompanying tables and text 
note that the following abbreviations are used extensively in 
the reporting: 

TLM Traditional Method 

FSG Functional Skills Grammar (Method) 

FSM Functional Skills Method 

TR Tape Recorder 

AA Audio-Active Language Laboratory 

AR Audio-Record Language Laboratory 

M Male 

F Female 

These are often used in conjunction, i.e. FSM-AA-M. 



THE EXPERIMENTAL SCHEMATIC 



Due to statistical considerations, the experimental unit 
was the intact class, following the "Nonequivalent Control 
Group Design" — Experimental Design 10 — described by Campbell 
and Stanley (1963). The arrangement of teaching strategies 
and systems was patterned on the methods of "The Factorial 
Design (two factors)" discussed in Linquist (1953)* This 
type of design may be considered preferable in State-directed, 
in situ research undertakings. Existing administrative 
practices must be honored, "I’m-a-guinea-pig attitude" 

Campbell and Stanley (1963) is minimized when utilizing in- 
tact classrooms, and without differential recruitment related 
to experimental treatment, the study may approach true ex- 
perimentation. 

The rationale for selecting "factorial design" proce- 
dures were (l) it provided increased precision in that the ex- 
perimental variable(s), e.g., the specific teaching strategy, 
was employed across different systems; (2) it facilitated 
analysis of interaction effects in addition to studying the 



main effects. Finally, the experiment provided teacher, 
school, and school system replication. 

The three teaching strategies and three language labora- 
tory treatments then fell into a seven-celled experimental 
schematic: 



FIGURE I 

THE EXPERIMENTAL CELLS 



Traditional 




Classroom 
Tape Recorder 



Audio-Active 

Laboratory 



Audio -Re cord 
Laboratory 



Functional Skills + 
Grammar 

Functional Skills 




The asymetrical design resulted from the fact that stu- 
dents in the traditional classes were not expected to utilize 
language laboratories or classroom tape recorders other than 
for presentation of materials of a "cultural** or "enrichment" 
nature. 

Independent variables : These are the (l) foreign lan- 

guage teaching strategies, (2) the language laboratory systems, 
and (3) the strategy-system combinations. 

Dependent variables : these were 

(1) achievement scores in each of the skill areas at 
sel6ctfed poifttfe during the academic year, at the end 
of one, two, and three academic years; 

(2) student attitudinal and interest factors. 



Languages: 



The languages studied were French and German. The 
inclusion of the most popular foreign languages taught in 
the public secondary schools was due to the following con 
slderatlons: 



o 
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a. It increases substantially the ability to generalize 
the results. If only a language with one type of structure 
was studied it is obvious that the findings could not be 
generalized to languages with very different structures. This 
alone warranted the inclusion of one Romance and one non- 
Romance language. 

b. Originally the inclusion of Spanish was strongly sup- 
ported by the Department of Public Instruction's foreign lan- 
guage specialists and project consultants. Dr. Albert Valdman 
reported that it was extremely difficult to get a group of 
foreign language teachers who taught different languages to 
work on problems that seemed to be of mutual concern. Each 
felt that his own language presented unique problems. In- 
dependent of the conclusiveness of the results, teachers 
whose language was not among those studied would be skeptical 
that they could apply the experimental findings in their teach- 
ing. However, since the study of more than two languages seemed 
unwieldy and expensive, the investigators concentrated their 
efforts on the study of French and German, representing signifi- 
cantly different types of languages. 



POPULATION AND SAMPLE 



In the most restricted sense, the population to which 
inferences from the Project findings would apply is the 
"hypothetical" parent population - which is the group con- 
sisting of all individuals "like those in the experiment." 
(Lindquist, 1953) In this case these would be the teachers, 
students, and schools with the characteristics listed in the 
discussion of the sample. 

However, a survey of schools in Pennsylvania with lan- 
guage laboratory installations supports extending the infer- 
ences to the "real" population of all schools, teachers, and 
students in the Commonwealth, and possibly in the United 
States. This survej revealed that the schools reporting 
language laboratories are broadly representative in geographic 
location, school and district size, teacher ability, instruc- 
tional expenditure per child, and pupil ability. Installation 
of the laboratories in some schools and not in others might be 
readily attributed to other factors Irrelevant to the outcomes 
of the experimental treatment. 

Soon after the Project became a reality, school superin- 
tendents throughout Pennsylvania were apprised' of the experi- 
ment and invited to attend regional discussion conferences to 
consider the proposal in detail. These meetings were held on 
March 29, 30 and 31 * 1965 at Harrisburg, West Chester and 
Allentown and again on May 4 at California, Pennsylvania. 
Approximately sixty public school representatives attended 
each of the four meetings. 
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The program for each conference was essentially the same: 
the demonstration of the need for educational research in 
naturalistic settings by Dr. N. Sidney Archer, a review of 
research in modem foreign languages by Dr. Alfred D. Roberts 
and the presentation of the research proposal by Mr. Emanuel 
Berger. In each case this was followed by a question period 
to allow those administrators and curriculum planners in at- 
tendance to clearly understand the program. 

By the end of the 1965 school year, one hundred and 
twenty teachers had been tentatively identified as Project 
participants and had agreed to participate. These persons 
and their administrators were asked to reserve a week in late 
August, 1965> for a pre-experimental training conference. 

Each participating school distrcit was also asked to 
identify a person to act as the local Project Coordinator, 
freeing the Superintendent from direct concern with minor 
administrative affairs. In many cases this person was an 
Assistant Superintendent or Curriculum Coordinator. They 
were to prove invaluable to the later relatively smooth 
functioning of the experiment. 

In anticipation of embarking upon a program of evalu- 
ation of the effectiveness of the language laboratory, a sur- 
vey of selected teacher characteristics and laboratory facili- 
ties was undertaken. A questionnaire was designed to identify 
teacher qualifications for teaching the major foreign lan- 
guage, the specific languages being taught, the description of 
the equipment, and the number of students enrolled in lan- 
guage courses at the specified school. This was sent to each 
of the secondary schools in the Commonwealth reporting a 
language laboratory. 

The sample schools were selected from among those re- 
sponding to the survey. Those schoo?.s indicating a willingness 
to participate, which also had the ocher experimental requisi- 
tes and ready geographic accessibility, constituted the pool 
from which the final random choice of experimental subjects 
was made. The specific school and teacher characteristics 
required included: 

(Note that items 1 and 4 below were not necessarily 
applicable to the traditional group). 

1. The school had a language laboratory. 

2. Willingness to abide by procedures demanded by re- 
search requirements. 

3. Offering of a three and/or four-year sequence of 
French and German. 

4. Teachers had been trained, or were willing to enroll 
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Figure 2 Project Schools and Classes 
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in a course in audiolingual techniques and language labora- 
tory procedures. 

5 . Teachers had a "reasonable” command of the foreign 
language . 

» 

Schools participating in the research are shown on the 
map of Figure 2. One hundred and four teachers participated 
in the first year. of experimental instruction. Sixty-one 
intact classes were able to continue through a full two-year 
sequence within the experimental design. Of these sixty-one 
only ten had different teachers for Level I and Level II. 
Eighteen teachers who had participated in the first year of 
the Project and ten new teachers were selected to constitute 
a twenty-eight class, seven hundred student, replication of 
Level I. Lists of participating teachers and schools appear 
in Appendix A. 



DEFINITIONS OF STRATEGIES AND SYSTEMS 



In order to differentiate precisely the objectives, 
rationale and characteristics of each of the three teaching 
strategies, a select panel of modem foreign language educa- 
tors was convened. This group of consultants included: 

Dr. Robert Lado, Georgetown University 

Dr. Stanley Sapon, University of Rochester 

Dr. Wilmarth H. Starr, New York University 

Dr. W. Freeman Twaddell, Brown University 

Dr. Albert Valdman, Indiana University 

Dr. Donald D. Walsh, MLA Foreign Language Program 

Meeting for two days in Philadelphia, this group pre- 
cisely defined the three teaching strategies and three lan- 
guage laboratory systems under consideration. Dr. John 
Carroll, Harvard University, was unable to meet with the 
group but held a separate discussion with the research staff 
on June 2, 1965* Ur. Carroll suggested a fourth teaching 
strategy, "Traditional Modified” which was not included for 
logistic reasons. 



TEACHING STRATEGY I: THE TRADITIONAL METHOD 



The major objectives of foreign language instruction 
according to this method are: 

1. To read with facility in the foreign language. 

2. To translate from the foreign language into English 
and vice versa. 

3. To develop an appreciation for the foreign country' 
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culture, its people and its heritage* 

4. To develop a better understanding of the syntax and 
structure of the student* s native language* 

Carefully graded reading selections in the text incorpo- 
rate both the grammar to be learned and the vocabulary items. 
The student practices the grammar rules by applying them in 
written form to sample sentences following the lesson. Vo- 
cabulary lists are memorized and practiced through trans- 
lation from English into the foreign language. 

Rationale : Traditional Method 

The basis for the traditional approach is rooted in both 
common educational sense and a history of successful experi- 
ence. Pew would doubt that proficiency in a language *s gram- 
mar accompanied by command of its lexicon will result in the 
stated objectives. Also, those who have taught and assessed 
student achievement in foreign language through the ybars 
report that effective teaching procedures, as in other aca- 
demic subjects, produce the desired results. Unless there is 
convincing evidence to the contrary, "traditionalists" feel 
justified in supporting a "proven” method in preference to 
programs that have as yet to prove their worth in the class- 
room setting. Finally, educators maintain that a well edu- 
cated person should be acquainted with the literature and 
culture of other countries. 



TEACHING STRATEGY II: THE FUNCTIONAL SKILLS METHOD 



The primary objective of foreign language instruction 
according to the "functionalists" is that the student be able 
to use the language as it is used in the foreign country. It 
is considered essential that the four language skills be 
taught in a progression - listening first to the spoken word, 
followed by repeating orally that which was heard, then read- 
ing the graphic symbols that were both heard and spoken, and, 
finally, writing that which was heard, spoken and read. 

The "functional skills" are taught by means of the dialog 
and its associated activities. There is opportunity for ex- 
tensive student practice in both listening and speaking in the 
target language. Vocabulary is learned only in context while 
formal prescribed grammatical analysis is avoided. 

Rationale : Functional Skills Method 

The principle advanced by those supporting this method 
is that, essentially, language is speech. Written symbols 
are a derived and secondary form of language. We are able 
to use our mother tongue effectively long before we can read 
or write the graphic symbols representing the spoken word. 
Furthermore, it is claimed that language learning is a skill, 
not an intellectual discipline. It follows, then, that 
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methods effective in teaching science and mathematics are 
not ideally suited for cultivating language habits. More 
appropriately, the student is instructed to practice language 
forms to the point that his responses are automatic, in much 
the same way that he uses his own language. 



TEACHING STRATEGY III: THE FUNCTIONAL SKILLS -GRAMMAR METHOD 



This condition subscribes to both the objectives and the 
basic methodology of the "Functional Skills Method." The 
major point of contention is how best to develop structural 
mastery - the basis of effective language usage - in the 
school setting* 

According to this approach pattern drills are supple- 
mented by explicit instruction in the appropriate grammar. 
Extreme care is exercised to limit the grammar to clarify- 
ing the pattern which was practiced during the dialog - 
(grammar is not taught independently of the language habits 
developed) . 

Rationale : Functional Skills- Grammar Method 

Essentially, there is no empirical evidence to support 
the elimination of formal grammar instruction in teaching a 
foreign language. Indeed, Mueller (1958) reported that stu- 
dents frequently fail to perceive grammatical signals even 
after extensive drills. Others argue that the manner in which 
a child learns his native tongue is not entirely analogous to 
the way an adolescent learns a second language in the class- 
room- In the latter case the student can "bring his intel- 
lect to bear on his problems and can speed up immea curably 
through generalizations, shortcuts, and insights into the 
way the language operates if, and when, he understands its 
structure analytically." 

Finally, the accompanying explanation might serve to 
prevent possible student boredom when he indulges in repeti- 
tious practice for considerable periods of time. 



LANGUAGE LABORATORY, SYSTEM I: CLASSROOM TAPE RECORDER 



The simplest audio aid for the modern foreign language 
teacher is the classroom tape recorder. Its convenience and 
ease of operation as well as its low cost have made the tape 
recorder an integral part of the foreign language classroom 
even in schools equipped with more extensive facilities. 

The inclusion of the classroom tape recorder alone as a 
"laboratory strategy" reflected the insistence of many teach- 



ers that it was as effective as a more elaborate language 
laboratory. Statistically it represented the minimum base- 
line or " control" strategy. 

LANGUAGE LABORATORY , SYSTEM II: AUDIO-ACTIVE (LISTEN-RESPOND) 



This constitutes one type of "language laboratory." Each 
student position is equipped with a microphone, amplifier and 
headset. Usually there is more than one tape recorder or other 
program source at the teacher console. Finally, the teacher 
console is wired for monitoring individual student performance. 

The immediate and most cogent argument for this instal- 
lation is* the privacy and isolation afforded each student. 
Eliminating distracting noises is recommended if students are 
expected to discriminate new sounds that are distressingly 
similar to those of his own language and to other sounds in 
the foreign language. 

It is also claimed that hearing his own voice following 
that of the tape master, with amplification of similar quality, 
allows for effective correction when there is disagreement. 
Multi pie -program sources provide for small group instruction 
and facilitate flashbacks' to previous lessons that require 
review. 



LANGUAGE LABORATORY, SYSTEM III: AUDIO- ACTIVE-RECORD (LISTEN- 

RESPOND-COMPARE) 



The addition of recording facilities at student positions 
provides the teacher with a significant tool in developing 
"functional" skills. Principally, the student records the 
master and his responses and then compares these during play- 
back. Differing learning rates can be accommodated. This is 
a practical means for evaluating oral performances, and closer 
teacher supervision is possible than with less complete instal 
lations. 

Competent language educators favoring the use of the 
record facility offer as support an argument based on the 
method by which language is learned. They clair that the 
learning of a foreign phoneme occurs as a result of conscious 
attention to the process of how it is produced. As a result, 
knowledge of the articulatory phonetics is a definite aid. 



INSTRUCTIONAL CONTROLS 



As in any behavioral research, careful 
manipulative independent variables received 
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control of the 
primary consider- 



at ion throughout the experiment. These controls concentrated 
on teacher adherence to the assigned treatment and included 
teacher measures, teacher training, instructional guidelines, 
periodic group workshops and careful observation and super- 
vision. 



TEACHER CONTROL 



The principal sources of error attributable to teacher 
effects are (l) differences in teacher ability due to training 
and/or experience, (2) teacher non-adherence to assigned con- 
ditions in the experimental program, and (3) the nonspecificity 
of the assigned treatment and the daily teacher responsibilities. 
Because teacher adherence to the assigned treatment is a most 
important factor to control, a number of steps were taken to 
minimize even unintentional deviations. 

1. Teacher Numbers : The experiment was predicated on 

the basis of involving over one hundred teachers in an at- 
tempt to minimize bias due to teacher variation. 

2. Teacher Ability Control : All teachers who volunteered 

to participate in the experiment were given the Foreign Lan- 
guage Proficiency Tests for Teachers and Advanced Students « 
Educational Testing Service, 19^2. In addition, teachers who 
had recently spent considerable time (two or more years) in 
the country where their foreign language is spoken were ex- 
cluded. Participating teachers were expected to have had at 
least two years of teaching experience. 

3. Control for nonadherence to assigned treatment: 

a. Selection of Cooperating Teachers : Participants 

were selected from a pool of teachers who had the support of 
their schools and were willing to commit themselves in ad- 
vance to the requirements of the experiment. 

b. Pre-experlmental Workshop : One of the single most 

important controls of the variables of the research project 
was the week-long orientation meeting and workshop held from 
August 22 through August 25, 19&5* Here the Project Staff 
and participating teachers met with several Consultants on the 
campus at West Chester to discuss the implementation of the 
Project in detail. 

The workshop provided for (l) an orientation to the need 
for the limitations on educational research; (2) a detailed 
inticduccion to the experiment; (3) several sessions on test- 
ing with particular emphasis on foreign language testing; and 
(4) the assignment of teachers to strategies and training in 
two laboratory types utilizing both college and local school 
facilities. 
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Each teacher was thoroughly briefed In his expected role 
and In the teaching strategy he was expected to employ. De- 
tailed guidelines had been prepared for each teaching strategy 
and language laboratory treatment. Field Consultants and Work- 
shop Consultants spent many hours In small group meetings 
training teachers In their assigned strategy. 

Extra-Project Consultants for the workshop Included: 

Dr. Kenneth W. Mildenberger , Modern Language Association 

Dr. J. William Moore, Chairman, Department of Education, 
Bucknell University 

Dr. N. Sidney Archer, formerly Director, Bureau of Re- 
search, D. P. I. 

Mr. Eugene Hogenauer, MLA Test Development Committee 

Mrs. Marlette Reed, Educational Testing Service 

Miss Terry Gamba, Foreign Language Specialist, D.P.I. 

Mr. Harold Gruver, Hanover School District 

Dr. Douglas Ward, Pittsburgh School District 

The Project Staff had assumed that teachers agreeing to 
participate In the experiment were better professionally pre- 
pared than they appeared to be at the Initial meeting. Many 
were totally unfamiliar with the text materials that they were 
to use with experimental classes. The pre-experlmental train- 
ing thus proved of great benefit In orienting teachers to the 
research project. Teachers were compensated for participation 
In training workshops, for periodic group meetings and for 
collection of additional student data. 

In addition to the pre-experlmental meeting, three bi- 
monthly evaluation meetings were held In November, 19 65 » an( * 
January and March, 1966. At these sessions general discus- 
sions of matters pertaining to the project and Instructions 
relating to procedures were considered. A prominent feature 
of these sessions was the small group meetings structured 
around the various strategy-systems In which considerable 
attention was given to the problems peculiar to each group. 
Appropriate teaching techniques were demonstrated by selected 
teachers In each strategy-system and in panel discussions rele 
vanb topics were presented. 

All teachers* meetings were held both on the campus of 
West Chester State College and In the Pittsburgh area to 
Insure teacher attendance. A final first-year meeting was 
held In May, 19 66, to Insure uniformity of final student 
testing dates and procedures. Mr. F. Andre Paquette of the 
Modern Language Association addressed the West Chester group 
while Dr. Joseph Mastronle of the University of Pittsburgh 
spoke to teachers In both western Pennsylvania and at West 
Chester. 



c. New Teacher Orientation : With the extension of the 

research Into a second year and the establishment of a repll 
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cation of the. first year of the experiment, some twenty new 
teachers were added to the Project population, ten among the 
sixty-one continuing classes and ten in the Level I repli- 
cation. New Level I teachers attended a special pre-instruc- 
tional orientation workshop in Philadelphia on September 10, 
1966 where their role was carefully delineated. The ten new 
teachers with second-year continuing classes were individually 
oriented by their assigned Field Consultant. Expected roles, 
attitudes and expectations were carefully explained. When it 
became apparent on visitations that one new teacher was at- 
tempting to circumvent the purposes of the research experi- 
ment, her class — some twenty students who had been carefully 
observed and measured over a two-year period — were summarily 
dropped from the experimental population. 

d. Second -Year Evaluation Meetings : Four evaluation 

meetings during the second year of instruction enabled the 
Project Staff to reiterate the necessity for adherence to 
assigned teaching strategies, to receive feedback from 
Project teachers and to discuss procedures for upcoming 
testing. In addition, notable speakers were brought in to 
enhance the professional awareness of the Project teachers. 

Mr. P. Paul Parent of the Pennsylvania State University and 
Dr. Joseph Mastronie of the University of Pittsburgh met with 
Project teachers on November 5 and November 12, 1906 at 
Pittsburgh and West Chester, Dr. Wilmarth Starr addressed 
the spring evaluation meeting on April 1 at Plymouth-White - 
marsh and Mr. Alfred Smith of the Ohio State University 
spoke to the Pittsburgh area teachers on April 8, 196? • 

e. Third-year Evaluation Meeting : A final evaluation 

meeting was held on the campus of West Chester State College 
on May 4, 1968. All teachers who had ever been involved in 
the Project for any of the three years 1965-68 were invited 

to attend and participate. The meeting provided an opportunity 
for reaction to the findings of the experiment and to gain 
insights regarding the teachers' viewpoint of the research. 

Dr. Gertrude Moskowitz of Temple University discussed her work 
with interaction analysis and foreign languages with the 
participants. 



TEXT MATERIALS 



The data submitted to the Project by prospective participa- 
ting schools illustrated one of the complications of broad-scale 
research in the naturalistic setting of the public school class- 
room. The approximately eighty school districts indicated 
twenty-seven different sets of texts and instructional mate- 
rials were utilized in the teaching of French and German. It 
was evident that this was one of the several potentially con- 
founding variables which would seriously affect the results of 
the study. It was decided to reduce this number of texts to 
minimize this source of error. 
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All participating classes were required to adopt one of 
the following texts during the two-year instructional period. 
Schools purchased the complete program. Analyses and guide- 
lines were written by the Project Staff for each text (Ap- 
pendix B). Texts were specifically identified as represen- 
tative of a particular approach by the panel of expertfe (p.21). 

FRENCH I . 

Cours Elementalre de Franca is . Dale and Dale (TLM) 

Parlez-Vous Francals ? . Huebener and Neuschatz (TLM) 

New first Year French . O'Brien and LaFrance (TLM) 
Audio-Lingual Materials . Level I (FS) ^ 

Ecouter et Parler . Cote, Levy and O'Conner (FS) 

FRENCH II , 

Cours Moven de Francals . Dale and Dale (TLM) 

Oui, Je Parle Francals ! , Huebener and Neushatz (TLM) 
Audlo^Llngual Materials . Level II (FS) . , 

Ecouter . Parler et Lire . Cote "Levy, andr O' Conner ^F$fl . 

GERMAN I 

A First Course in German . Huebener and Newmark (TLM) 
Audio-Lingual Materials . Level I (FS) 

verstehen und Sprechen . Rehder, Twaddell and 0 Conner (FS) 

GERMAN II . 

A Second Course in German . Huebener and Newmark (TLM) 
Audio-Lingual Materials . Level II (FS) 

Sprechen und Lesen . Rehder, Twaddell and O'Conner (FS) 

Classes continued through the second year of experimental 
instruction moved into the respective Level II book at the 
conclusion of the first text. 



INSTRUCTIONAL GUIDES 



To assist in the adherence of teachers to assigned stra- 
tegy and laboratory treatments, specific guides were esta- 
blished by the Project Staff. These were essentially the 
same for each instructional strategy, differing only slight- 
ly in detail of coverage depending upon the text under consider 
ation. Samples are reproduced in the Appendixes for German 
only in the interest of economy since the French differed only 
in texts mentioned and units to be covered. Each teacher re- 
ceived the guidelines applicable to his assigned strategy and 
laboratory system. Guidelines were developed in detail for all 
Level I and Level II texts. Copies accompany the formal final 
report submitted to the United States Office of Education. 
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For the Functional-Skills + Grammar classes the gram- 
matical generalizations had to be written for those texts not 
including formal grammar. These were written by the Project 
Staff and included in the appropriate teacher's guide. 

Teachers were expected to be thoroughly familiar with the 
guidelines and examples. They served not only as a basic blue 
print for daily lessons but as a common reference point for 
discussions with the Field Consultants. These observers used 
the guidelines as a frame of reference for evaluation of teach 
er adherence to the assigned strategy. 



FIELD CONSULTANTS 



The Field Consultant was envisioned as the key figure in 
coordinating and unifying the many people involved in the Pro 
ject. They participated in the writing of the guidelines, in 
the meetings with the language consultants, arid were all com- 
petent and knowledgeable classroom teachers. 

The expected role of the Project Field Consultants was 
defined and criteria established for the positions. These 
included: 



1. Pennsylvania permanent certification to teach either 
French or German. 

2. Minimum of five (5) years of teaching experience. 

3. Master's degree in secondary education or language 
field, or equivalent supervisory experience. 

4. Experience in the use of the language laboratory. 

Field Consultants were employed through the regular pro- 
cedures established by the Department of Foreign Languages at 
West Chester State College. Four competent Consultants were 
employed and assisted actively in laying the groundwork for 
the experiment. They were expected to visit each Project class- 
room about twice a month, discuss the experiences of the teacher 
and advise teachers and administrators of forthcoming Project 
activities. They were not concerned with judging teacher per- 
formance as it related to the local school situations but only 
as it concerned adherence to the assigned teaching strategy. 

The Field Consultant then was to observe, advise and to act in 
a liaison capacity. 

Field Consultants completed a report form after each teacher 
visitation. This was intended to describe the lesson observed 
and to relate it to the assigned strategy. The preliminary 
instrument was changed in January, 1966, to one which allowed a 
more precise numerical assessment of adherence on a single page. 
These are reproduced in the Appendixes. 



Throughout the Project the field observers met bi-weekly 
with the headquarters staff and reported on the progress of 
the investigation. Problems of policy and procedure were re- 
solved and coordination of action insured by these frequent 
contacts which permitted discussions among the various Field 
Consultants . 

Teachers deviating markedly from the assigned strategy- 
system were dropped from that assignment and from the Project. 
Often the teacher remained totally unaware of this action. 
Field Consultants traveled many thousands of miles to visit 
widely scattered Project schools. One Consultant remained in 
residence in the Pittsburgh area for the full two-year period 
of the experiment. 



PART 2s CONDUCT OF THE RESEARCH 



IMPLEMENTATION OF THE RESEARCH 



With the granting of funds to support the proposed re- 
search under USOE Grant OE-7-48-9013-272, the Pennsylvania 
Foreign Language Research Project was established March 1, 

1965, with headquarters at the Cooperative Research Center, 

West Chester State College. Located approximately twenty 
miles southwest of Philadelphia, West Chester is the largest 
of the Pennsylvania State Colleges. The Foreign Language 
Research Project Staff was added to the regular college 
faculty for fiscal purposes with academic rank based upon 
the state college personnel system. The Project received 
full cooperation and support from the college, including the 
services of the Data Processing and Computer Center. 

As described in Part 1, one of the first undertakings of 
the Project was to enpanel a select committee of foreign lan- 
guage educators to establish precise definitions of the various 
teaching strategies and guidelines to be followed by teachers 
within each treatment. In addition, the counsel of several 
other noted foreign language educators was solicited on various 
aspects of the research design and evaluation. These included 
Dr. John Carroll, Harvard University; Mr. F. Andre Paquette of 
the Modern Language Association; Dr. Harold Bligh, Har court, 

Brace and World, Inc.; Dr. William Locke, Massachusetts Institute 
of Technology; Mrs. Eleanor Sandstrom, Philadelphia City Schools; 
and Mrs. Miriam Bryan, Educational Testing Service. 

Toward the close of the first year of experimental instruc- 
tion it became obvious that continued experimentation and re- 
search as well as replication were highly desirable. According- 
ly, an additional application for an extension of the Project 
was submitted to the United States Office of Education. When 
approved as Project 7-0133, "A Comparison of the Effectiveness 
of the Traditional and Audiolingual Approaches to Foreign Lan- 
guage Instruction Utilizing Laboratory Equipment," Immediate 
steps were taken to extend and replicate the research. 



PROJECT STAFF 



During the second and third years of the instructional phase 
of the Foreign Language Research Project, the following persons 
served on the professional Project Staff at West Chester State 
College: 
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Philip D. Smith, Jr,, Ph.D., Coordinator (1967-68), Foreign 
Language Research Projects 

Alfred D. Roberts, Ph.D,, Supervisor of Instruction, Chairman, 
Department of Foreign Languages (1965-67) 

Ralph A. Eisenstadt, M.A., Field Consultant ( 1965 - 68 ) 

A G G 1 G^fiVl t* pT'rtf'o OCOT 

William E. McDonald, B.A., Field Consultant (1965-67) 
Instructor 

Mary Ellen Allen, M.A. , Field Consultant (1966-67) 

Instructor 

Helmut A. Baranyi, M.Ed., Field Consultant (1967-68) 

Assistant Professor 

Haydee 0. P. Ern, M.E., Computer Programmer (1966-67) 

Lecturer 



ASSIGNMENT OF CLASSES TO TEACHING STRATEGIES 



Randomness of assignment of classes to experimental treat- 
ments was not entirely practical due to conditions dictated by 
the real school environment. Certain modifications from the 
ideal had to be made and are discussed below. For example, some 
schools did not have any student recording facilities and could 
not be included for possible selection in the audio-record (AR) 
group. It was also considered unwise to assign teachers to a 
classroom teaching strategy to which they had a strong objection. 

In the main, traditional classes were taught by teachers 
who expressed a preference for this strategy. Such was not 
always the case since many teachers indicated a willingness to 
dedicate themselves to what ever strategy they were assigned. 
These and the Functional Skills Method (FSM) and Functional- 
Skills + Grammar (FSG) groups were arbitrarily and randomly 
assigned to their strategies. 

Laboratory treatments depended upon the individual facili- 
ties of each school. Schools with no laboratory facilities 
were, of necessity, assigned to the Tape Recording (TR) group. 
Laboratories with no recording facilities were by definition 
excluded from the AR group and were assigned to the Audio- 
Active treatment. In many cases laboratories had only enough 
recording facilities for part of the class. These classes 
were then envisioned as "split" classes, one small class of 
Audio -Re cording (AR) within the same strategy. Students were 
assigned to each treatment by use of a random numbers table. 
Statistical analysis of interaction among these "split” classes 
was included in later data processing and evaluation. 

It was possible to completely randomly assign fifty-three 
Level II classes, thirty-one French and twenty-two German, among 
the Functional Skills, Functional-Skills + Grammar, Audio-Active 
and Audio-Record treatment combinations. The complete break- 
down within each treatment is illustrated in Figure 3 « 
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FIGURE 3 



DISTRIBUTION OF CLASSES BY TEACHING STRATEGY 
AND LABORATORY SYSTEM, SECOND YEAR 
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In order to avoid both direct competition between experi- 
mental classes and experimental contamination by teachers and 
students "comparing notes," it was felt advisable to permit 
only one teaching strategy within each school building. There- 
fore, while an individual school could have several Project 
classes in both French and German, within that school only one 
teaching strategy was assigned . 

In essence, it was felt by the research staff that the 
research design was not seriously impaired in the transfer into 
the real school environment. Random assignment of classes be- 
tween the two functional skills strategies and the various 
language laboratory types was largely maintained and enough 
classes were involved to minimize extraneous variables. 



MEASUREMENT INSTRUMENTS 



In order to duplicate the conditions and advantages avail- 
able to the normal school district, the Foreign Language Research 
Project based its primary evaluation program on standardized 
instruments. All instruments were administered to the total 
student population with the exception of a ten percent random 
sample chosen for administration of the more lengthy and 
individualized portions of the final tests. In cases where 
standardized tests to evaluate certain student skills and at- 
titudes were not available, instruments were produced for the 
Project. The testing program and the specific tests selected 
reflected the counsel of Dr. John Carroll in the discussions 
on the original experimental design. 



TABLE 1 



SKILLS AND INSTRUMENTS 



Foreign Language Behavior 


Criteria 


1. Listening Comprehension 


MLA CooDerative Classroom 
Listening Test 


2. Listening Discrimination 


Valette Listening Discrimination 
Test 


3 • Speaking 


MLA Coooerative Classroom 
Sneaking Test 

Valette Sound Production Test 


4. Reading 


MLA Coonerative Classroom 
Reading Test 


5. Writing 


MLA CooDerative Classroom 
Writing Test 


6. Attitudes 


Student ODinion Scale (semantic 
differential) 
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At the beginning of the 1965-66 year, immediately after 
the opening of school and before instruction in the foreign 
language commenced, a number of pre-experimental tests were 
given to students in Project classes. These had two purposes: 
II) to measure student native ability and aptitude in order 
to permit the establishment of predictive criteria and (?) 
to determine the amount of prior exposure of Project students 
to foreign language instruction. While it has been maintained 
that foreign language permits an ideal setting for research 
since it presumes a "zero" starting point (Carroll, 1963 ) 9 It 
was decided to administer a foreign language pre-test due to 
the possibility of student exposure to some programs of foreign 
languages in the elementary schools, to instruction by tele- 
vision, to exposure by travel and the possibility of a foreign 
language background in the home. 

During the first few days of school, original Project stu- 
dents rook the California Short-Form Test of Mental Maturity . 

The Modern Language Aptitude Test (short formTJ the Cooperative 
French Test ( 1939 ) or the Cooperative German Test ( 19^1) > and 
the Listening Comprehension portion of the MLA Cooperative 
Foreign Language Tests . Finally, each student completed an at- 
titude and orientation inventory, the Student Opinion Scale . 
to assess his feelings toward foreign language instruction be- 
fore such instruction commenced and answered specific questions 
concerning his expectations and aspirations. 

The mid-year testing program, completed in January, in- 
cluded the Listening Comprehension and Reading portions of the 
MLA Cooperative Foreign Language Tests . a second administr- 
tion of the Student Opinion Scale and the administration to 
all students of the Listening Discrimination Test for French 
and German especially developed for the experiment by Dr. 

Rebecca Valette of Boston College. In addition, a randomly 
selected ten percent sample of the entire student population 
was administered the Speaking portion of the MLA Cooperative 
Language Test . 

The final testing was done in May and included a re-tes- 
ting of the students on the French Cooperative Test and the 
German Cooperative Test as well as the Listening Comprehension 
and Reading portions of the MLA Cooperative Foreign Language 
Tests . The same ten percent sample of students again comple- 
ted the Speaking portion and for the first time the Writing 
section of the MLA Tests . A third administration of the 
Student Opinion Scale was completed for all students. 

During the second year of instruction the testing program 
was less rigorous. Both continuing and replicating students 
took the MLA Cooperative Classroom Listening Test in September 
1966. Continuing students took the Reading Test . Replicating 
students were given the Modern Language Aptitude Test and the 
California Test of Mental Maturity as pre-experimental measures. 
At mid-year both groups took the Listening and Reading Test 
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again In alternate form. At the end of the year the same tests 
plus the Valette Listening Discrimination Test were given to 
all students. A randomly selected ten percent sample of all 
classes were given the Speaking and Writing Tests , the Valette 
Sound Production Test and a personal interview to assess at- 
titudes and expectations. All students completed the Student 
Opinion Scale during the fall, winter and spring testing. 



MLA COOPERATIVE CLASSROOM FOREIGN LANGUAGE TESTS 



The Co operative Classroom Foreign Language Tests were de- 
veloped under ths direction of the Modern Language Association 
and are published by the Educational Testing Service. They are 
available in two level, and in two forms. Alternating forms 
of the beginning, "L" , level were used throughout the experi- 
ment for Levels I and II with the advanced ”M" form utilized 
as a final measure for Level III. These tests reflect current 
concepts and instructional objectives of modern foreign lan- 
guage instruction. The Listening portion of the test which was 
administered as a pre-, a mid-, and a post-experimental; measure 
is contained on a tape recording. The Reading and Writing por- 
tions of the test can be completed by the student in a test 
booklet while the Speaking protion must be individually ad- 
ministered and recorded on tape. 

The scoring of the Speaking Test is a demanding and pos- 
sibly subjective process. In order to insure that this test 
was evaluated accurately, the Project Field Consultants were 
especially trained by the Educational Testing Service. A 
training session was provided for them at the ETS Center in 
Princeton, New Jersey, and consultants from the Educational 
Testing Service visited Project headquart cs at West Chester 
State College in a follow-up training session. At the con- 
clusion of these two training periods the Field Consultants 
were considered to be adequately trained to score the Speak - 
ing Test objectively. 



STUDENT OPINION SCALE 



A student attitude inventory was developed for the Project 
by Dr. Milton C» Woodlen and Mr. Emanuel Berger. The scale 
consists of student reactions to a single question concerning 
foreign language instruction and permits a choice among eigh- 
teen descriptive polar adjectives. It is reproduced in Appendix 
A. The second portion of the attitude inventory was changed at 
various times throughout the experiment in order to assess 
various aspects of the student's self concept and aspiration, 
fhe first administration included a fourteen item inventory 
of self-rating concerning foreign languages. The student was 
also asked to predict how long he thought he would study a 
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foreign language and what foreign language skills he considered 
important to himself as an individual. Later administrations 
included the semantic differential scale with varying student 
questionnaires. The Student Opinion Scale was administered 
three time during the year. 



LISTENING DISCRIMINATION TEST 



The Project Staff and consultants were concerned that none 
of the tests available were designed specifically to measure 
the exact ability of a student to discriminate the sounds of a 
foreign language. The Listening portion of the MLA Tests, are 
a measure of the student’s ability to comprehend the language 
in life-like situations. It was thought desirable to be able 
to measure the student’s exact ability to discriminate among 
the phonemds of a foreign language. Under a separate contract 
with the Department of Public Instruction, Dr. Rebecca valette, 
Director of the Language Laboratory of Boston College and an 
authority on foreign language testing, developed Listenin g 
Discrimination Tests for French and German. 

These tests are designed to measure every important sound 
in the language and consist of four parts* discrimination 
between very similar sounds in both English and French or 
German, the ability to identify the same or different soun gg 
in the target language, the ability to identify the SSHfi SSl 
different vowel sounds in French or German, and the ability to 
discriminate rhymes in French and German. These four portions 
are combined to provide a total score which is considered to oe 
indicative of the student’s ability to closely discriminate 
among the sounds of spoken French and German. The tests were 
produced by Dr. Valette and recorded by native speakers for 
administration to the Project population. All students took 
the Listening Discrimination Test in January. Since this was 
the only administration of this test it was considered a 
"final" measurement. 

After the close of the instructional period an extensive 
psychometric analysis of the Listening Discrimination es \ 
was made at the Pennsylvania State University (Williams, 19°^* 
The "Summary and Conclusions" portion of this report observe 
in part: 



The psychometric characteristics of the FLDT and the 
GLDT were almost identical. The relationship of many of 
the items in the two tests to the total-test performance 
is quite loxtf. This leaves open the question of whether 
the measurement of different linguistic areas in the 
FLDT and GLDT was actually accomplished in general.... 

...In general, the fact that some of the items show 
outstanding discrimination indicies, makes the examina- 



tion look quite promising. However, an Investigation of 
the validity of the test by some external criterion would 
seem necessary. . . 

While this validation has not been undertaken, the test 
was utilized as an indication of aural discrimination in the 
final analysis. 

SOUND PRODUCTION TEST 



Dr. Valette completed a German/French Sound Production 
Test for the Project in 1967. This companion test to the 
Listening Discrimination Test measures exactly the same 
critical sounds on a one-to-one correspondence, perception to 
production. The test is of the mimicry type in wnich the stu- 
dent imitates a short phrase uttered by a native speaker. 
Professional recordings were made of both tests by the National 
Tape Service. 



TEACHER ADHERNECE TO ASSIGNED STRATEGIES 



The Project was fortunate in that the foreign language texts 
selected by the guiding panel of specialists (p. 21) clearly dif- 
ferentiated between the two fundamental teaching strategies. 
"Traditional” and "functional skills" or "audiolingual" texts 
contrast sharply and strongly inhibited teachers from marked 
deviation from their prescribed fundamental approach. In both 
cases a perversion of the philosophy of the authors of either 
type of materials would have required an extensive process of 
rewriting and editing on the part of the individual teacher. 
Purposefully irregular classroom observations were intended to 
detect such deviations from assigned experimental treatments. 

Each teacher was visited a number of times during the 
year by his/her assigned Field Consultant. Visits were at- 
temped bi-weekly and were not announced in advance. To pro- 
vide the Field Consultant with criteria for evaluation of 
strategy adherence and for discussion with the teachers, a 
short check list was developed appropriate for each strategy. 
Reproduced in Appendix C, each major characteristic of each 
strategy could be rated by the Field Consultant as follows; 



These ratings were established by the Field Consultants 
themselves and discussed frequently at bi-weekly staff meetings. 
Here the Field Consultants met with the Supervisor or Instruc- 



1. excellent 

2. good 

3. fair 



4. poor 

5. very poor 

0. not observed 
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tion and/or the Project Coordinator. Observation and adherence 
were discussed on an individual teacher basis. 

Obviously, not every possible teaching procedure was ob- 
served each time the teacher was visited — the check list pro- 
vided for all main characteristics of the strategy. By the 
same token, each unannounced school visitation could not be 
objectively recorded on an observation sheet. Despite the 
fact that teachers would advise their Field Consultant of major 
changes in the schedule, the real school setting dictated visi- 
tations on days when there were teacher illiness, fire drills, 
classes shifted or cancelled, student testing and ocher inter- 
ruptions of the class routine. 

All of these factors combined to provide the Project 
Staff with a large number of Observation Reports of visitations 
made on an unannounced and irregular basis. Standards for 
ratings were established and refined in the bi-weekly staff 
meetings. These ratings and the overall "mean rating” are 
shown in Tables2-4 where data from all Observation Reports 
dealing with each strategy was combined to show a composite 
rating for each method. 



TABLE 2 



ADHERENCE TO STRATEGY - "TRADITIONAL” - SECOND YEAR 



Ratine Scale 


1 


Ratings 
_ J> 1_ 


JL. 


Item 
5 Mean 


1. Vocabulary drill 


8 


6 


1 


— 


— 1.53 


2. Translation of reading lesson 


15 


3 


2 


1 


— 1.48 


3. Grammar — formal analysis 


19 


4 


2 


— 


— 1.32 


4. Pronunciation — teacher — max.i of 
class time 


9 


12 


7 




— 1.93 


5. Pronunciation — student — max. i of 
class time 




8 


16 


3 


— 2.81 


6. Reading ^or total comprehension 


12 


6 


5 


1 


— 1.79 


?. Writing — free composition 


1 


1 


1 


1 


— 2.50 


8. Culture (refinement) 


7 


4 


4 


— 


— 1.80 


9. Use of tape recorder 


— 


— 


1 


— 


— 3.00 


10. Use of visual aids 


2 


, 5 


3 


— 


-- 2.10 




73 


49 


42 6 

Overall 


0 

Mean=2.03 



TABLE 3 



ADHERENCE TO STRATEGY-*' FUNCTIONAL SKILLS -GRAMMAR" -SECOND YEAR 



Rating Scale 


1 


2 


Ratings Item 

3 4 5 Mean 


1. Teacher speaks foreign language 


40 


24 


8 




— 


1.56 


2. Students speak foreign language 


6 


36 


26 


4 


— — 


2.39 


3. Grammar: Descriptive; use 

before rules 


43 


22 


1 


1 


— — 


1.40 


4. Speaking only what was listened to 


6l 


8 


2 


— 


— — 


1.17 

'1.42 


5. Reading as direct communciation 


41 


19 


4 


— — 


— — 


6. Reading only what was listened to 
and spoken 


60 


4 


1 


-- 


— 


1.09 


7. Writing only what was listened to 
spoken and read 


56 


2 








1.03 


8. Language as a cultural behavior 
pattern 


67 


3 








1.04 


9. Testing as demonstration of 
functional proficiency 


28 


5 


1 


-- 


— 


1.21 


10. Average use of tapes--ten minutes 
per day o . 


27 


19 


9 


1 


— 


1.71 


11. Average pronunciation drill — 3-5 
minutes per day 


9 


13 


26 


3 


1 


2.50 


12. Vocabulary taught in context only 


6? 


4 


1 


— 


— 


1.09 


503 


159 


79 9 

Overall 


1 

Mean 


=1.4? 



TABLE 4 



ADHERENCE TO STRATEGY- "FUNCTIONAL SKILLS METHOD "-SECOND YEAR 



Rating Scale 

1. Teacher speaks foreign language 

2. Students speak foreign language 

3. Grammar: Subsidiary to functional 

skills 

4. Speaking only what was listened to 

5. Reading as direct communication 

6. Reading only what was listened to 
and spoken 

7. Writing only what was listened to, 
spoken and read 

8. Language as a cultural behavior 
pattern 

9. Testing as demonstration of 
functional proficiency 

10. Average use of tapes--ten minutes 
per day 

11. Average pronunciation drill — 3-5 
minutes per day 

12. Vocabulary taught in context only 







Ratings 


Item 


1 


2 


. JL. 


4 


. _5_ 


Mean 


26 


7 


2 


1 


— _ 


1.39 


2 


17 


14 


3 


— 


2.50 


23 


8 


2 




1 


1.47 


30 


4 


1 


1 


— 


1.25 


20 


9 


1 


— 


— 


1.37 


25 


3 


— 


1 


— 


1.21 


24 


— 


— 


1 




1.12 


32 


3 


— 


— 


1 


1.19 


10 


2 


2 


— 


1 


1.67 


12 


11 


2 


3 


1 


1.97 


6 


4 


8 


3 


1 


2.50 


32 


3 


— — 


1 


— 


1.17 


mr 


71 


32 


l4 


5 








Overall 


Mean 


=1.57 
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It can be seen that the majority of classroom activities in 
each strategy were rated by the Field Consultants as either 
Excellent” or "Good.” Therefore, activities observed were 
largely of the type expected from the strategy. Teachers in 
"Functional Skills” strategies received more "Excellent-Good" 
ratings than "Traditional" teachers. Field Consultants observed 
students in TLM classes pronouncing the foreign language more 
than had been anticipated. While exemplary "traditional" teach- 
ing has never excluded the spoken language, it was presumed to 
have been utilized less than it was in reality observed. 

Comparable "overall means" for each strategy are rather 
close for both years of the experiment: 





TLM 


FSG 


FSM 


First Year 


2.37 


1.38 


l.5l 


Second Year 


2.03 


1.4? 


1.57 



with a lower ("closer") rating for "traditional" teachers in 
Second Year. It should be noted that the Field Consultants 
stated that the poorer teachers elected to leave the experi- 
ment at the conclusion of the first year. 

Of particular interest in regard to teacher assignment and 
adherence to assigned strategies is the first portion of a 
transcript of their candid remarks (see Appendix H) , at a meet- 
ing a full year after the conclusion of the experiment. Teach- 
ers* expressed the opinion that they had fully attempted to teach 
as they had been asked. In the final analysis of teacher ad- 
herence, however, the basic materials dictate what activities 
occur in the transfer of theory into the reality of the average 
classroom. Gross departures were easily detected by the ex- 
perienced observers. 



ER?C 



FIGURE 4 

% CHRONOLOGY OF THE RESEARCH 

% 

March\ 1965-^roject Funded 

. . .Discussion and Planning Meetings 

...Identification of Participating Schools 
JuneX. . .Consultant Panel Meeting 
July-August X .. .Preparation of Materials 

August \. . .Pre-esperimental Workshop 
September \ „ . .Pre-experimental Testing 
November x ...Fall Evaluation Meeting 

1966 

JanuaryX . . .Mid-year Evaluation Meeting 
FebruaryX. „ .Mid-year Testing 

MarchX ...Spring Evaluation Meeting 



May 



Preparation of materials.., 
New Teacher Workshop, 



.Final Evaluation Meeting 
Final Testing 

July 



September 



Pre-experimental testing 
Fall Evaluation Meeting. . 



-Replication 



begins 

November 

1967 



Mid-year Testing. . .X January 
Spring Evaluation Meeting. . . \ April 

Final Testing... \ May 
Data Compilation begins .. .X June , 1967 
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SUMMARY OF THE INSTRUCTIONAL PHASE 



All students in the experimental population completed 
pre-, mid-year and final testing on a number of skills over 
a two-year period. Measures of intelligence, aptitude and 
achievement were obtained before instruction in the foreign 
language commenced. Mid-year measures were obtained on the 
Listening and Reading skills as well as on the exact ability 
of the student to discriminate among the important sounds of 
the foreign language. Final testing included not only the 
Listening and Reading skills but a measure of Vocabulary and 
Grammar for all students the first year. A ten percent random 
sample of all students was tested in the Speaking and Writing 
skills both years. Identical student attitude inventories were 
given before, during and at the completion of each year of 
foreign language instruction in order to assess student attitude 
shifts and to relate these to the method of instruction. 

Any student who did not complete every single measure 
was automatically dropped from the experimental population, 
resulting in an attrition from approximately 3 >500 to a final 
2,171 students at the end of the first year and to 1,090 at 
the end of the second year. 

Teachers generally stayed within the assigned teaching 
strategies as assessed by the Field Consultants during period- 
ic unannounced observations. FSM and FSG teachers as a group 
were rated between "good” and "excellent” in this respect 
while TLM teachers as a group were rated between "fair" and 
"good.? Every effort was made to maintain adherence and yet 
fairly represent the "real school" environment. 

1 

} 
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PART 3s 



DATA ANALYSES 



From its inception, the emphasis of the Project was to 
determine, (l) the comparative effectiveness of the three 
teaching strategies and (2) the comparative effectiveness of 
the three language laboratory systems. From this analysis it 
was hoped that (3) a determination might be made of the opti- 
mum strategy-system combination. The Project retained Dr. 
Chauncy M. Dayton, a specialist in educational research and 
statistical analysis on the faculty of the University of 
Maryland, to oversee the task. The analyses were made at the 
Computer Science Center of the University of Maryland for both 
experimental years. 



THE STATISTICAL PROGRAM 



The statistical program utilized by Dr. Dayton was the 
Multivariate Analysis of Variance ("MANOVA") developed by the 
Biometric Laboratory of the University of Miami. Readers de- 
siring a complete description of th^ program should refer to 
Multivariate Statistical Programs by D, J. Clyde, E. M. Cramer 
and R. J. She r in, published by the Biometric Laboratory in 
1966, pp. 20-41 o An improved version of the program was used 
during the second year analysis. 

In essence the Multivariate Analysis of Variance program 
performs analyses of variance, covariance and of regression, 
providing exact solutions in either orthogonal or non-ortho- 
gonal cases. Reanalyses may be done with varying criteria, 
covariates, contrasts and ordering. 

Computer output on each strategy - laboratory system 
analyzed included (1) means and standard deviations on all 
pre-, mid- and post-measures; (2) the within cells correlations 
on each measure; (3) a test for linear dependency among the 
variables; (4) estimates of error effects; (5) an analysis of 
variance using Wilk’s Lambda Criterion and Canonical Cor- 
relations with Rao*s approximate F-test; and (6) analyses of 
covariance with as many as six covariates . 

In the subsequent portions of the report, only data judged 
essential to interpretation by the reader is reproduced. The 
complete computer output totals several large volumes. Proba- 
bilities of occurrence are reported for all pertinent F-ratios. 
Since the program can be two-dimensional, sex was often used 
as a second factor. This permitted a view of the role of sex 
,s an active factor in second language learning. In many cases 
a difference was pre-supposed but did not occur. This per se, 
is significant and is the very reason such tables are reported. 



The basic unit of the analysis is the teacher (class) 
mean . Student and teacher data were rigorously checked before 
submission to the statistical analysis. Preliminary screening 
had eliminated incomplete observations on students. The com- 
puter program automatically reported any observations with 
insufficient data and deleted them from the computations. 

Since the data was examined several times by the Multi- 
variate Analysis of Variance Program to examine various facets, 
computer outputs changed slightly for each analysis. For this 
reason a representative examination, one which included the 
entire student population, was chosen for the reporting of 
"Means and Standard Deviations" rather than several repro- 
ductions of essentially identical data. 



ANALYSIS OF SECONDARY OBJECTIVES 



The secondary objectives (see p. 14, Objectives 3 - 7 ) of 
the research were evaluated at the Cooperative Research Center, 
West Chester State College by the Project Coordinator. Facili- 
ties included an IBM 1401 Computer system and a competent staff. 
Programs utilized were largely of the standard IBM type. A 
few were especially written for the Project by Dr. Martin Higgins 
and Mr. Wesley Fasnacht of West Chester State College, Mr. 

Russell Dusewicz of the State Department of Public Instruction, 
and Mr. Helmut Baranyi of the Project Staff. 



ANALYSIS OF VARIANCE AND TUKEY MULTIPLE RANGE TESTS 



Objectives 4, 5 and 6 of the study dealing with the com- 
parison of student attitude indices, attitude shifts, and the 
relationship of various student and instructional measures to 
final achievement were first tested for significance with a 
one-way analysis of variance. This particular procedure was 
selected since the unit of analysis was the student group and 
there was considerable disproportionality on unequal numbers of 
students per treatment. If significant differences within 
the population were indicated by the analysis of variance, 
additional tests were employed to compare differences between 
pairs of means for significance. 

Since there is some apprehension among statisticians as 
to the increasing likelihood of obtaining significant dif- 
ferences among groups by computing large numbers of t or 
Critical Range tests, the more conservative Tukey "A 17 
multiple range test was usually employed. This test requires 
the ordering of group means and computation with a harmonic 
number of subjects. Considerable confidence can be attached 
to significance reported using this test. 



o 

ERIC 
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CORRELATIONS AND MULTIPLE REGRESSION 



To establish the relationship between such variables as 
age, grade, teacher proficiency, student attitude, intelligence 
and aptitude with student achievement in foreign language the 
correlation coefficient (r) was employed. It was also used to 
determine the interrelationships among the various foreign 
language skills and among all discrete experimental measures. 

The computation was done on a 60 x 60 variable correla- 
tion program on an IBM 1403 computer. Levels of significance 
for correlation coeff iciencs, two tailed test, are identified 
where applicable from a standard table of "Critical Values of 
the Correlation Coefficient" (after Fisher and Yates) at N-2 
degrees of freedom. 

Multiple correlation coefficients (R) also were computed 
to determine the best predictors of foreign language achievement. 
Statistical significance of reported multiple correlation coef- 
ficients was determined by computation of an F-ratio using the 
formula s 



where N is the number of observations and K is the number of 
predictors. 




o 



TABLE 5 



EXPERIMENTAL MEASURES 



ORIGINAL POPULATION 



Pre-Experlmental 



Mid-Year 



End -Year 



1. Calif. Test Mental Mat. 

2. Mod. Lang. Apt. Test 

3. Cooperative F/G Test 

4. MLA Coop. List. 

5. Student Opinion Scale 

(S.O.S.) 



6. MLA Coop. List. 

7. MLA Coop. Read, 

8. MLA Coop. Spk,* 

9. MLA Coop. Write* 

10. S.O.S. 

11. List. Discrim. 



12. MLA Coop. List. 

13. MLA Coop. Read. 

14. MLA Coop. Spk.* 

15. MLA Coop. Writ* 

16 . S.O.S. 

17. Cooperative F/G 



1965-66, 2,171 students I 



Fall 2nd Year 

18. MLA Coop. List. 

19. MLA Coop. Read 

20. S.O.S. 



Mid-Year 

21. MLA Coop. List. 

22. MLA Coop. Read. 

23 . S.O.S. 



Post-Experimental 

24. MLA Coop. List. 

25 . MLA Coop. Read. 

26. List. Discrim. 

27. MLA Coop. Spk.* 

28. S.O.S. 

29. MLA Coop. Writ* 

30. Speech Prod.* 



1966-67, 1,090 students- 



REPLICATION 



Pre-Experlmental 



Mid-Year 



Post-Experimental 



1. Calif. Test Mental Mat. 5. MLA Coop. List. 8. MLA Coop. List. 

2. Mod. Lang. Apt. Test 6. MLA Coop. Read. 9. MLA Coop. Read. 

3. MLA Coop. List. 10. MLA Coop. Spk.* 

4. S.O.S. 7. S.O.S. 11, S.O.S, 

12. MLA Coop. Writ* 

13. List. Discrim. 

14. Speech Prod.* 

^ — 1966-67, 663 students I 



* 



= 10# random sample tested 



SECTION III - RESULTS OF THE RESEARCH 
PART lr REPLICATION OF THE FIRST YEAR 



The results of Project 5-0683, "An Assessment of Three 
Foreign Language Teaching Strategies Utilizing Three Language 
Laboratory Systems" were in essence that "traditional" classes 
did as well or better than "functional skills" classes on all 
measures. Including the newer MLA Cooperative Classroom Tests , 
and that the language laboratory systems employed for two half- 
periods per week had no effect. Since these conclusions are 
not what had been anticipated by the profession, replication of 
the major portions of the experiment was of primary importance. 

Accordingly, eighteen French and ten German classes under- 
took a replication of Level I. Teacher training and testing 
were repeated for the few new teachers involved. In the main, 
replication teachers were cn-going Project teachers who were 
willing to begin with another class or teachers who could not 
continue with an original Project class for scheduling reasons 
but who were willing to begin again with a second class. 

Measurement of the replicating students emulated the 
original classes but was somewhat narrower, concentrating on 
the listening, speaking, reading and writing skills. The 1939- 
^1 Cooperative French and German Te sts , originally used as both 
pre- and post-experimental "traditional" measures were dropped. 
As already mentioned, pre-experimental measures consisted of (l) 
the California Test of Mental Maturity . (2) the Modern Language 
Aptitude Test , and (5T ohe MLA Cooperative Classroom Listening 
Test in French or German. Post-experimental measures were (l) 
the MLA Cooperative Classroom Listening and (2) Reading Tests 
and (3) the Valette Listening Discrimination Test. 



ASSIGNMENT OF REPLICATING CLASSES 



Unlike the earlier Project 5-0683, 1 " ne replicating students 
could be randomly assigned between the two types of language 
laboratory systems, Audio-Active (AA) and Audio-Active-Record 
(AR). No functional skills classes utilizing a classroom tape 
recorder only were included. Instead the "control" classes 
were the "traditional" classes with no systematic use of the 
tape recorder. The actual breakdown of replicating classes 
was as follows: 



FIGURE 5 

ASSIGNMENT OF REPLICATING CLASSES 

Traditional 

3 French 
1 German 



Functional-Skills + 
Grammar 



Functional 

Skills 



The replication classes then, in essence, concentrated 
on (l) a contrast between the three teaching strategies and 
(2) a contrast of Audio-Active, Audio-Record and no language 
laboratory systems as measured on tests reflecting the "newer" 
philosophies of modern foreign language instruction. 



Audio-Active Audio-Record 



8 Fre 
5 Ger 


ich 

nan 


7 Fre 
5 Ger 


ich 

nan 



t 



random assignment of 
students to recording 
facilities 



COMPARISON OF ORIGINAL AND REPLICATING STUDENTS 



Since replication is an attempt at duplication, a compar- 
ison was made of the replicating students with the original 
Project population. In theory, they should have had the same 
characteristics, permitting validation of the results of Project 
5-0683. In actuality there did exist some significant dif- 
ferences between the two groups when compared directly on the 
pre-experimental measures. 

Tables 6, 51 and 52 (Appendix D) show the comparison be- 
tween the two groups on sub-parts and total of the pre-experi- 
mental California Test of Mental Maturity (Short Form). Signi- 
ficant differences existed between the two groups on the "Lan- 
guage IQ" portion of the test. In the original population 
German students did significantly better. In the replication 
the significance occurred in favor of the French students. 
Significant differences exist between original and replicating 
students in both languages. 



On the "Non-Language I,Q," portion of this same test there 
are no differences each year between languages but a signifi- 
cant difference (105) between original arid replicating French 
students (Table 51* Appendix D). The "Total IQ" reflects the 
significant differences found in the sub-tests (Table 52 , 

Appendix D). 

A significant di: ference (.001) also existed between origi- 
nal and replicating experimental French students on the Pre- 
experimental Modern Language Aptitude Test (Table 7 ). There 
was no significant difference between German groups the two 
years. The situation was reversed for the MLA Cooperative 
Classroom Listening Test with significant differences in German 
but not in French (Table 8 ) . Since significant differences 
among groups on these pre-experimental measures existed, they 
were included as covariates on the multiple analysis of 
covariance upon which the experiment was evaluated. Post-experi- 
mental cell means and standard deviations are shown in Table 8 . 

TABLE 6 



COMPARISONS OF POPULATION BY INTELLIGENCE 



Pre-Experimental California Test of 


Mental Maturity 


( short 


form) 


Language IQ 


N 


Mean 


S.D, 




1. Original French Students 


1205 


112.94 


11.31 


^.01 


2. Original German Students 


945 


114.76 


10.18 


3. Replicating French Students 


397 


115.26 


10.47 


< .01 


4. Replicating German Students 


242 


112.10 


11.55 


Source df Sm.Sq. 

Between 3 3310 , 

Within 2785 327466. 




Mean Sq . 

1103.33 

117.58 




F 

9 . 38 ** 



SIGNIFICANCE OF DIFFERENCES BETWEEN MEANS 



Group : 
Mean: 



Tukey "A" Multiple Range Test 
4 12 3 

112.10 112.94 114.76 115.26 



4 112.10 

1 112.94 

2 114.76 

3 115.26 



.84 2.66** 3.16** 

I.83** 2.32** 

— .50 



** p. <.01. 





TABLE 7 -A 

COMPARISON OF ORIGINAL AND REPLICATING STUDENTS 
MODERN LANGUAGE APTITUDE TEST 



• 




FRENCH 


N 


Mean 


S.D. 


Original 

Replicators 






1203 

397 


46.20 

49.72 


16.11 

18.05 


Source 


df 


Sm.Sqs. 




Mean Sq . 


F 


Between 

Within 


1 

159B 


3695.20 

440843.20 




3695. 20 
275.87 


13.40*** 






GERMAN 


N 


Mean 


S.D. 


Original 

Replicators 






945 

242 


46.04 

46.20 


16.55 

17.83 


Source 


df 


Stn.Sas. 




Mean Sq . 


F 


Between 

Within 


1 

1185 


4.90 

335280.0 




4.90 

292.94 


.02 


*** p.< .001. 




TABLE 7-B 









COMPARISON OF ORIGINAL & REPLICATING STUDENTS, PRE-EXPERIMENTAL 
COOPERATIVE CLASSROOM LISTENING COMPREHENSION TEST 

FRENCH 







N 


Mean 


S.D. 


Original 




1201 


9.66 


3.72 


Replicators 




397 


9.38 


5.36 


Source 


df 


Sm.Sqs. 


Mean Sq . 


F 


Between 


1 


■ 21.61 


. 21.61 


1.23 


Within 


1596 


28028.32 

GERMAN 

N 


17.56 

Mean 


S.D. 


Original 




945 


10.82 


3.95 


Replicators 




242 


7.66 


6.46 


Source 


df 


Sm.Sqs. 


Mean Sq. 


F 


Between 


1 


1927.73 


1927.73 


92.23** 


Within 

** p. ^ .01. 


1185 


24767.05 


20.90 
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ADHERENCE TO ASSIGNED STRATEGIES 



Replicating teachers were visited and evaluated by the 
same criteria as regular Project teachers to evaluate their 
adherence to the assigned teaching strategy. The observers* 
ratings were analyzed in Tables 9 - 1 . 1 . The analysis shows that 
replicating teachers were judged "Excellent” to "Good” in 
their adherence to the assigned teaching strategy. 

The area in which all three strategies seem to have 
deviated the most from expected norms was that of the pro- 
portion of class time spent in student pronunciation of the 
foreign language. In the four "traditional” classes both the 
teacher and student spoke the second language more than 
was expected. In the "functional skills” strategies the 
students did not speak as much as might have been expected 
but were still rated as "Good” to "Fair” in the amount of 
time spent in speech production. 



TABLE 9 

ADHERENCE TO STRATEGIES - "TRADITIONAL” - REPLICATION 



Ratine Scale 


1 


2 




Ratings Item 
4 5 Mean 


1. Vocabulary drill 


4 


3 


1 


— — 


— — 


1.63 


2. Translation of reading lesson 


3 


2 








1.40 


3 . Grammar — formal analysis 


11 


4 








1.2? 


4 . Pronunciation — teacher — max. i of 
class time 


2 


4 


10 






2.50 


5 * Pronunciation — student — max. i of 
class time 




3 


8 


5 


.. 


3-13 


6. Reading for total comprehension 


4 


2 


2 


— 


— 


1.75 


?. Writing — free composition 


1 


2 


1 


— 


— 


2.00 


8. Culture (refinement) 


2 


1 


3 


— 


— 


2.1? 


9 . Use of tape recorder 












0.00 


10. Use of visual aids 


2 


3 


2 


— — 


— 


2.00 




29 


24 


26 5 
Overall 


0 

Mean : 


= 1.79 



TABLE 10 



ADHERENCE TO STRATEGY- "FUNCTIONAL SKILLS- 


■GRAMMAR"- 


•REPLICATION 








Ratings 




Item 


Rating Scale 


1 


. _2_ 


_L_ 


4 


_5_ 


Mean 


1. Teacher speaks foreign language 


30 


8 


3 


— — 


— 


1.34 


2. Students speak foreign language 

3. Grammar: Descriptive; use before 


3 


26 


12 


“ — 




2.22 


rules 


29. 


5 


1 

-L 


— 


— 


1.20 


4. Speaking only what was listened to37 


2 


1 


— 


— 


1.10 


5. Reading as direct communication 

6. Reading only what was listened to 


24 


5 








1.17 


and spoken 


27 


1 


1 


— 


— 


1.10 


7. Writing only what was listened to 


9 










1.14 


spoken and read 


20 


— 


— 


1 


— 


8. Language as a cultural behavior 














pattern 


41 










1.00 


9. Testing as demonstration of 














functional proficiency 


15 


4 








1.21 


10. Average use of tapes — ten minutes 












1.64 


per day 


15 


7 


1 


1 


1 


11. Average pronunciation drill — 3-5 












2.08 


minutes per day 


8 


11 


4 


3 


— 


12. Vocabulary taught in context only 


40 


1 








1.02 


289 


70 


23 


5 


1 





Overall Mean=1.35 



TABLE 11 



ADHERENCE TO STRATEGY-" FUNCTIONAL SKILLS METHOD "-REPLICATION 



Ratings Item 

Rating Scale 1 2 3 4 5 Mean 

1. Teacher speaks foreign language 23 7 2 — — 1.34 

2. Students speak foreign language 4 12 16 — — 2.38 

3. Grammar: Subsidiary to functional 

skills 17 9 1 — -- 1.4l 

4. Speaking only what was listened to 29 4 — — — 1.12 

5. Reading as direct communication 24 3 1 — — 1.18 

6. Reading only what was listened to 

and spoken 25 2 1 — — 1.14 

7. Writing only what was listened to, 

spoken and read 24 — — — — 1.00 

8. Language as a cultural behavior 

pattern 31 — — — — 1.00 

9. Testing as demonstration of 

functional proficiency 14 3 — — — 1.18 

10. Average use of tapes — ten minutes 

per day 12 4 7 — — 1.78 

11. Average pronunciation drill — 3-5 

minutes per day 11 6 8 — — 1.88 

12. Vocabulary taught in context only 31 1.00 

2*5 50 3 % 0 0 



Overall Mean=1.37 




Replicating classes were rated by the same standards — and 
with the same irregularities of observation and activities — as 
the original Project classes. It seems desirable to determine 
if the replication does indeed reflect the original in terms of 
adherence to treatment. Unfortunately, the Observation Reports 
do not lend themselves to precise tests of statistical dif- 
ferences. 

A less rigorous test, comparing the relative proportions 
for both groups of "Excellent-Good" to "Fair-Poor-Very Poor" 
ratings was made by the use of chi- square. The hypothosis was 
advanced that the proportion of "high" and "low" ratings should 
be the same within a particular strategy for both years. Data 
and results are shown in Table 12 . 

TABLE 12 

COMPARISON OF ORIGINAL AND REPLICATING 
TEACHER ADHERENCE TO STRATEGY 
"TRADITIONAL" 

Observers * Ratings Original Replicating 

Excellent, Good 191 53 

Fair, Poor, Very Poor 105 32 

Chi Square = .13 at 1 df, not significant 

"FUNCTIONAL SKILLS -GRAMMAR" 

Excellent, Good 951 359 

Fair, Poor, Very Poor 208 29 

Chi Square = 24.57 at 1 df, p. ^ .001. 

"FUNCTIONAL SKILLS METHOD" 

Excellent, Good 778 295 

Fair, Poor, lery Poor 111 3 o 

Chi Square - .58 at 1 df, not significant 

"Traditional" and "functional skills method" classes seem 
to have been rated about the same during both first years of 
instruction. "Functional skills-grammar" teachers were rated 
as adhering more closely to the intent of the research (p.^.OOl) 
during the replication than in the original experimental classes. 
Differences in instruments and criteria preclude analysis 
across strategies. 

In terms of teacher adherence to assigned techniques, the 
Project Staff felt that the replication was a fair representation 
of the original experimental classes. In some ways it may have 
been better since most replicating teachers were highly interested 
"original" teachers who undertook a new class within the frame- 
work of the experiment. 
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RESULTS OF THE REPLICATION 



Objective 1: To determine which of three foreign language 

teaching strategies is most effective . . . and . . 

O bjective _ 2 : To determine which of three language laboratory 

s ystems is, best suited economically and Instructlonallv . . . 



The analyses of achievement in foreign language skills 
among the twenty-eight replicating classes confirm the earlier 
contusions of Project 5-0683 that there existed significant 

between teaching strategies on audio-lingual skills 
ana that the type of language laboratory employed had no effect 
on student achievement. The analyses of covariance on the 
inal^ MLA Cooperative Classroom Listening and Reading Tests 
and the Valette Listening Discrimination Tests by stratiifand 
system are shown in Tables 13 through 17 . 

contrasts to achieve significance occur in French 
on the Valette Listening Discrimination Test (Table 17). An 
attempt was made to obtain speaking and writing measures on a 
en percent randomly selected sample of the replicating classes. 
However, due to the small number of actual individuals for whom 
data was available, the researchers chose not to include this 
sample in the analysis. 



TABLE 13 



ANALYSIS OF COVARIANCE BY STRATEGY 
Criteria: Final LB Listening Test 



Covariates : 

1 . Language IQ 2 . Mod. Lang. Apt. Test 

3 . Pre-Exp. LA List. Test 4. Pre-Exp. Coop. Test 
5. Mid-yr. LB Read Test 6 . Mid-yr. List. Discrim. Test 



CONTRAST 






REPLICATING FRENCH I 


REPLICATING GERMAN I 










(18 classes) 


(10 classes^ 










Frratio 


F-ratio 


1 . FSG vs 


TLM 






.303 


.108 


2. FSM vs 


TLM 






2.742 


.000 


3 . FSG vs 


FSM 






.288 


.126 


4. FSG vs 


FSM 


at 


AA 


.105 


.275 


5. FSG vs 


FSM 


at 


AR 


.245 


.014 




TABLE 14 







/ ' 



ANALYSIS OF COVARIANCE BY STRATEGY 
Criteria: Final LB Reading Test 



Covariates: 

1 . Language IQ 2. Mod. Lang. Apt. Test 

3. Pre-Exp. LA List. Test 4. Pre-Exp. Coop. Test 
5. Mid-yr. LB Read Test 6 . Mid.yr. List. Discrim. Test 



CONTRAST 



REPLICATING FRENCH I 
( 1 8 classes) 



REPLICATING GERMAN I 
(10 classes) 



F-ratio F-ratio 



1 . FSG vs TLM .116 2.617 

2. FSM vs TLM .000 4.454 

3. FSG vs FSM .300 .316 

4. FSG vs FSM at AA .953 1.129 

5. FSG vs FSM at AR .114 .016 



i 

i 

U 




o 



TABLE 15 



ANALYSIS OF COVARIANCE BY LABORATORY TYPE 
Criteria: Final LB Listening Test 



Covariates: 

1. Language IQ 2. Mod. Lang. Apt. Test 

3* Pre-Exp. LA List. Test 4. Pre-Exp. Coop. Test 
5. Mid-yr. LB Read Test 6. Mid-yr. List. Discrim. Test 



CONTRAST 



REPLICATING FRENCH I 
(18 classes) 



REPLICATING GERMAN I 
(lO classes) 



F-ratio F-ratlo 

1. AA vs AR at FSG *323 .552 

2. AA vs AR at FSM .099 .377 

3. AA vs AR .080 .189 



TABLE 16 

ANALYSIS OF COVARIANCE BY LABORATORY TYPE 
Criteria: Final LB Reading Test 



Covariaces: 

1. Language IQ 2 . Mod. Lang. Apt. Test 

3* Pre-Exp. LA List. Test 4. Pre-Exp. Coop. Test 
5. Mid-yr. LB Read Test 6. Mid-yr. List. Discrim. Test 



CONTRAST 




REPLICATING FRENCH I 


REPLICATING GERMAN I 






(18 classes) 


(10 classes) 






F-ratio 


F-ratio 


1. AA vs 


AR at 


FSG 1.323 


1.559 


2. AA vs 


AR at 


FSM . 080 


1.834 


3 . AA vs 


AR 


.337 


4.230 





TABLE 17 



ANALYSIS OF COVARIANCE BY STRATEGY AND SYSTEM 
Criteria: Final Listening Discrimination Test 

Covariates: 

1. Language In 2. Mod. Lang. Apt. Test 

3* Pre-Exp. LA List. Test 4. Pre-Exp. Coop. Test 
5. Midi-yr. LB Read Test 6. Mid-yr. List. Discrim. Test 

CONTRAST REPLICATING FRENCH I REPLICATING GERMAN I 



(18 classes) (10 classes) 

F-ratlo p. F-ratlo p.^ 

1. FSG vs TLM .907 .084 

2. FSM vs TLM 29.398 .01 FSM^TLM .123 

3. FSG vs FSM 7.258 .05 FSG>FSM .261 

4. FSG vs FSM at AA 1.173 .106 

5. FSG vs FSM at AR .866 — - — .070 

6. AA vs AR at FSG 1.074 .240 

7. AA vs AR at FSM 1.343 .432 

8. AA vs AR 3.762 .432 
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Objective 6 : To determine the strengths and weaknesses 

of selected commercial programs. had led to the discovery of 
significant achievement differences between student using the 
ALM text and the Holt, Rinehart and Winston Ecouter rt Parler — 
Verstehen und Sprechen at the end of both Level I <md Level II. 
This warrented checking within the replication population. The 
results, shown in Table 18, indicate that students utilizing 
the Holt Materials scored significantly higher on the MLA 
Cooperative Classroum Listening Test but not on the Reading 
Test. 



TABLE 18 

COMPARISON OP ACHIEVEMENT BY TEXT, 

REPLICATING FUNCTIONAL SKILLS STUDENTS 

Text I Text II 







Mean 


S.D. 




Mean 


S.D. 


C.B. 


French, N=240 








N=100 








.1. Final LA 


List. Test 


l4.6- : 


5.12 




16.40 


6.13 


2.53* 


2. Final LA 


Read. Test 


15.82 


4.65 




16.20 


5.94 


• 57 


German, N=l4l 








N=74 








1. Final LA 


List. Test 


14.24 


4.92 




16.22 


7.34 


2.08* 


2. Final LA 


Read. Test 


13.73 


4.16 




14.78 


5.04 


1.56 



* p. <.05. 



Objective 7 : To identify teacher factors related to stu - 

dent achievement. 



Project 5-0683 had concluded that a hypothesized relation- 
ship between teacher proficiency and preparation measures and 
class achievement did not exist after one year of classroom 
instruction. Confirmation or refutation of this conclusion 
was considered of great importance. 

The scores of replicating teachers on the MLA Proficiency 
Test for Teachers and Advanced Students were again correlated 
with the mean achievement of their classes on the Valette 
Listening Discrimination Test , the four skills portions of the 
MLA Cooperative Classroom Tests and the class mean Opinion 
Scale index. The correlation coefficients are reported in 
Table 19. 
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TABLE 19 



CORRELATIONS BETWEEN TEACHER PROFICIENCY 
AND CLASS ACHIEVEMENT AFTER TWO YEARS 

Correlation Coefficients 
FRENCH, N=18 



Teacher 

Proficiency 

Score 


List. 

Disc. 


LB 

List. 


Class Mean 
LB LB LB 

Read. Soeak Write 


Opinion 

Scale 


1. Listen 


.20? 


-.158 


-.007 


-.517* 


-.212 


-.232 


2 . Speak 


.407 


.035 


-.223 


-.429 


-.528* 


-.363 


3. Read 


.471* 


.286 


.014 


-.554* 


-.294 


-.463 


4. Write 


.279 


-.002 


.080 


-.476* 


-.198 


-.278 


5. Ap. Ling. 


.279 


-.107 


-.377 


-.239 


-.476* 


-.035 


6. Cult. & Civ. 002 


-.088 


-.232 


-.311 


-.151 


-.548* 


7. Prof. Prep.. 282 


-.016 


-.288 


-.061 


-.193 


-.214 


Teacher 

Proficiency 

Score 


List. 

Disc., 


LB 

List. 


GERMAN, N= 

lb LB 

Read Soeak 


8 

LB 

Write 


Opinion 

Scale 



1. Listen 

2. SpeuK 

3 . Read 

4. Write 



-.101 

-.056 

-.266 

-.216 



.305 .309 .081 

.735* .430 -.139 



.344 

.084 



5. Ap. Ling. -.152 



.690 .481 -.416 -.178 

.704 .456 -.233 .010 

.506 .291 -.490 -.555 



6. Cult.& Civ-. 272 -.136 -.102 -.366 -.566 

7. Prof. Prep. .796* -.291 -.409 -.053 -.060 



-.294 

-.063 

-.164 

-.243 

.106 

-.058 

.707* 



The few classes involved, especially in German, make the 
values of the correlation coefficient required to be signifi- 
cantly greater than zero quite high. Enough French classes 
(N=l8) were compared to permit reasonable assumptions of proba- 
bility. Few correlation coefficients reached the required 
values to become significant. Those which were significant 
reached the .05 level. Of the seven significant correlation 
coefficients in French, six are negative, repeating a pattern 
reported in the final report of the first year of this study 
(Project 5-0683). Thus, there seems again little direct re- 
lationship between teacher proficiency and class achievement 
as measured on standardized tests. Teacher proficiency also 
seems to have had no relationship to the overall attitude of 
the class toward foreign language study. 



SUMMARY 



The replication phase of Project 7-0133 successfully com- 
pleted the same experiment as original Project classes, ad- 
hering significantly more closely to established instructional 
guidelines. The conclusions of the replication fully support 
the reported conclusions of Project 5-0683 (the first year of 
this study) . 



PART 2: RESULTS OF THE SECOND YEAR 

OF EXPERIMENTAL INSTRUCTION 



The second year of the experiment consisted of a slightly 
more narrow focus with the elimination of the older 1939~4 1 
Cooperative Tests and the reduction of the number of objectives. 
"Traditional” classes did ^ significantly better on the grammar, 
reading and vocabulary measures of the older Cooperative Tests 
at the end of one year of instruction in both French and German. 
Since these tests were especially reprinted for the experiment 
and are no longer available to the profession, during the second 
year evaluation was mainly predicted on the new MLA Cooper ative 
Classroom Tests . 

The evaluation of teaching strategies and language labora- 
tory systems and the determination of an optimum strategy-system 
combination (Objectives 1 and 2) depended upon an analysis of 
covariance utilizing from four to six measures known to be 
highly related to the criterion as covariates. This multivariate 
analysis was described more fully in earlier sections of the 
report. 

Objective 1 : To determine which of three foreign language 

teaching strategies is most effective in achieving each of the 
four foreign language objectives t i.e. listening compre hension, 
speaking fluency , reading and writing . 

The analysis of covariance indicates no significant dif- 
ferences after two years of instruction among the three teaching 
strategies in either listening comprehension (Table 21 ) or 
listening discrimination (Table 22). A ten percent random 
sample of classes who took the MLA Cooperative Speaking Test 
also indicates that no advantage existed for any strategy 
(Table 23). 

A smaller sample of students, twenty-seven individuals 
from twelve French II classes and thirty-six from sixteen German 
II classes, took the Valette Speech Production Tests . These 
tests, concentrating on the individual's production of 
individual sounds of French and German, indicate some 
significant differences in favor of the "Functional Skills" 

(FSM and FSG) classes (Table 24). The small sample and the 
non-validation of the test itself, prohibit firm conclusions 
based upon this data. 

"Traditional" classes achieved significantly higher in 
reading than the "Functional Skills Method" classes {Table 25 ) • 
This significant difference occurred only in French at the 
end of the first year but in both French and German after 



TABLE 20 



POST EXPERIMENTAL CELL MEANS AND STANDARD DEVIATIONS 



French 


List.Discr^m. 


LA List. 


LA Spk. 


LA Read. 


LA Write 


1. TLM 


48.79 


21.01 


36.36 


25.53 


53.63 




7.18 


5.73 


7.36 


8.61 


23.57 


2. FSG-TR 


45.00 


23.67 


33.33 


26.91 


49.16 




7.21 


7.40 


2.58 


9.56 


31.26 


3. FSM-TR 


52.34 


21.12 


43.50 


19.80 


43.00 




6.06 


6.41 


5.22 


7.39 


8 • 80 


4. FSG-AA 


49.33 


22.84 


31.70 


19.91 


30.22 




6.74 


6.30 


7.95 


7.17 


14 . 66 


5. FSM-AA 


48.04 


21.44 


34.25 


20.94 


45.00 




9.25 


9.91 


3.70 


6.85 


12.50 


6. FSG-AR 


48.89 


19.51 


30.00 


19.57 


37.06 




7.85 


6.80 


9.50 


6.62 


18.78 


7. FSM-AR 


47.38 


23.25 


32.33 


22.25 


48.50 




8.20 


5.30 


5.08 


5.99 


14.77 


German 


1. TLM 


45.69 


19.38 


39.57 


23.46 


55.73 




8.18 


7.43 


6.36 


9.10 


15.92 


2. FSG-TR 


45.36 


19.06 


37.16 


16.01 


51.41 




7.17 


6.98 


9.08 


6.34 


14.54 


3. FSM-TR 


44.79 


21.52 


36.00 


18.40 


53.33 




10.50 


5.32 


8.48 


6.38 


28. 08 


4. FSG-AA 


47.62 


14.99 


31.60 


15.47 


34.91 




6.04 


6.46 


2.64 


4.49 


13.30 


5. FSM-AA 


47-.-50 


19.03 


31.48 


15.65 


43.06 




9.70 


6.59 


11.22 


5.08 


18.42 


6. FSG-AR 


43.64 


21.40 


36.60 


17.04 


45.10 




7.69 


6.33 


9.28 


5.28 


22.78 


7. FSM-AR 


38.87 


18.83 


34.62 


17.15 


38.37 




8.79 


8.30 


12.57 


6.89 


23.81 
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TABLE 21 



ANALYSIS OF COVARIANCE BY STRATEGY 
Criteria: Final LB Listening Test 

Covariates : 

1. Language IQ 2. Mod. Lang. Apt. Test 

3. Pre-Exp. LA List. Test 4. Pre-Exp. Coop. Test 
5. Mid-yr. LB Read Test 6. Mid-yr. List. Discrim. Test 



CONTRAST 




FRENCH (24 


classes) 


GERMAN 


(25 classes 






F-ratio 




F-ratio 


P. <- 


1 . FSG vs 


TLM 


.724 


.411 


o 

o 

• 


.960 


2. FSM vs 


TLM 


.132 


.723 


2.581 


.130 


3. FSG vs 


FSM 


.511 


.489 


.48? 


.497 



TABLE 22 



Criteria: Final Listening Discrimination Test 

Covariates : 

1. Language IQ 2. Mod. Lang. Apt. Test 

3. Pre-Exp. LA List. Test 4. Pre-Exp. Coop. Test 
5. Mid-yr. LB Read Test 6. Mid-yr. List. Discrim. Test 



CONTRAST 




FRENCH 


(24 classes) 


GERMAN 


(25 classes 






F-ratio 


P. < 


F-ratio 


P. 


1. FSG vs 


TLM 


.970 


.3^4 


.052 


.824 


2. FSM vs 


TLM 


.594 


.456 


.008 


.932 


3 . FSG vs 


FSM 


.494 


.496 


.057 


.815 



two years. The differences in reading (Table 25 ) at the end of 
the second year between "Traditional” and "Functional Skills + 
Grammar" strategies is not significant. 

On the MLA Cooperative Writing Test , an instrument per- 
mitting no translation, there existed no significant differ- 
ences among the ten percent sample of the three strategies. 

It had existed at the conclusion of Level I in French in favor 
of the "Traditional" classes (Table 26 ). 

TABLE 23 

ANALYSIS OF COVARIANCE BY STRATEGY 
TEN PERCENT RANDOM SAMPLE 
Criteria: Final LB Speaking Test 



Covariates : 

1. Language IQ 3. Coop. Achievement Test 

2. Mod. Lang. Aptitude Test 4. Pre-Exp. LA List. Test 



CONTRAST 



1. FSG vs TLM 

2. FSM vs TLM 

3. FSG vs FSM 



Criteria: 



FRENCH (21 classes) 

F-ratio p. <. 

.434 
.515 
.300 



GERMAN (21 classes) 



F-ratio 


P«< 


.090 


.770 


.425 


•5 31 


.648 


.442 



TABLE 24 
ANALYSIS OF COVARIANCE 
TEN PERCENT RANDOM 
Valette Speech 



.527 

.491 

.597 



BY STRATEGY 



SAMPLE 



Production Test 



Covariates : 

1. Language IQ 3. Coop. Achievement Test 

2. Mod. Lang. Aptitude Test 4. Pre-Exp. LA List. Test 



CONTRAST 


FRENCH (12 
N=27 


classes) 


GERMAN 


(16 classes) 
N=36 




F-ratio 


e_. 


F-ratic 


1 P. < . 


1 . FSG vs TLM 


6.076 


.133 


26.533 


,004**FSG > 


2. FSM vs TLM 


21.276 


.044 FSM > 


.173 


.695 


3. FSG vs FSM 


.926 


.437 


8.478 


, 033 **fsg> 


Reanalysis 










2b FSM vs TLM 


27.970 


.034 FSM > 







t 



TABLE 25 

ANALYSIS OF COVARIANCE BY STRATEGY 
Criteria: Final LB Reading Test 



Covariates : 

1. Language IQ 2. Mod. Lang. Apt. Test 

3. Pre-Exp. LA List; Test 4. Pre-Exp. Coop. Test 
5. Mid-yr. LB Read Test 6. Mid-yr. List. Discrim. Test 



CONTRAST 



1. FSG vs TLM 

2. FSM vs TLM 

3. FSG vs FSM 



FRENCH (24 classes) GERMAN (25 classes) 



S-ratio p. < 

.112 .7^4 

8.833 .012** 

.527 .482 



F-ratio 

1.717 
FSM<TLM 4.543 
.026 



P* <» 

.211 

.051* FSM<TLM 
.874 



TABLE 26 

ANALYSIS OF COVARIANCE BY STRATEGY 
TEN PERCENT RANDOM SAMPLE 
Criteria: Final LB Writing Test 



Covariates: 

1. Language IQ 3* Cooperative Achievement Test 

2. Mod. Lang Apt. Test 4. Pre-Exp. LA List. Test 



CONTRAST 




FRENCH 


(21 classes) 


GERMAN 


(21 classes) 






F-ratio 


P. < 


F-ratio 


p. < 


1. FSG vs 


TLM 


.018 


.895 


.333 


.577 


2. FSM vs 


TLM 


2.64? 


.135 


.113 


.7^ 


3. FSG vs 


FSM 


.186 


.676 


.027 


.873 






In summary, after two years of instruction, no signifi- 
cant differences existed among the three teaching strategies 
in the listening, speaking and writing skills as measured by 
the MLA Cooperative Classroom Tests . Significant differences 
occurred on the Reading Test in favor of the "Traditional” 
classes versus the "Functional Skills" strategies in both French 
and German. 

Objective 2 : To determine which of three language labora - 

tory systems is best suited economically and Inst rue tionally « 
to the development of pronunciation and structural accuracy . 

The objective, as stated, is concerned most with the 
influence of the various language laboratory systems on the 
audio-lingual skills. The known high correlation of these 
skills with reading warranted its inclusion in the contras- 
tive analysis. 

Table 27 indicates no significant difference on the 
Listening Test among classes utilizing only a classroom 
tape recorder daily and those receiving additional practice 
in language laboratories twice weekly, either audio-active 
or audio-record. No significant differences exist among the 
same groups on the Valette Listening Discrimination Test 
(Table 28 ) . 

No significant differences exist among the various 
laboratory types as measured by the final MLA Speaking Test 
(Table 29). On the Valette Speech Production Test (Table 30 ) 
a significant difference occurred in favor of the classroom 
tape recorder over both language laboratory systems combined 
in German. The limitations of this untried test and the 
small sample size prevent generalization. 

On the final MLA Reading Test in French several signifi- 
cant differences existed, audio-active greater than audio- 
record overall (AA> AR, Table 31 ) and the tape recorder classes 
achieving better than both language laboratory types in the 
"Functional Skills + Grammar" strategy. The audio-active 
laboratory classes did better than tape recorder classes in 
the "Functional Skills Method." 

These differences occurred only in French with its less 
phonetic orthography and not in German. They are unsupported 
by commensurate significant differences in the audio-lingual 
skills. 
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TABLE 2? 



ANALYSIS OF COVARIANCE, TAPE RECORDER vs 
LANGUAGE LABORATORY SYSTEMS 



Criteria: Final LB Listening Test 

Covariates : 

1. Language IQ 2. Mod. Lang. Apt. Tdst 

3. Pre-Exp. LA List. Test 4. Pre-Exp. Coop. Test 
5. Mid-yr. LB Read Test 6. Mid-yr. List, Discrim. Test 



CONTRAST FRENCH (2 4 classes) GERMAN (25 classes) 



Fr-ratlo p . ^ F-ratio P» < 



1 . 


TR 


vs 


AA 






.696 


.421 


.002 


.969 


2 , 


TR 


vs 


AR 






.346 


.567 


1.650 


.220 


3. 


AA 


vs 


AR 






.365 


.557 


.002 


.962 


4. 


TR 


vs 


AA 


at 


FSG 


.022 


.884 


.041 


.842 


5. 


TR 


vs 


AR 


at 


FSG 


.392 


.543 


.071 


.793 


6. 


TR 


vs 


AA 


at 


FSM 


.828 


.381 


.232 


.638 


7. 


TR 


vs 


AR 


at 


FSM 


.052 


.823 


2.293 


.152 


8. 


AA 


vs 


AR 


at 


FSG 


.644 


.438 


.052 


.823 


9. 


AA 


vs 


AR 


at 


FSM 


.132 


.723 


2.297 


.152 
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TABLE 28 



ANALYSIS OF COVARIANCE, TAPE RECORDER vs 
LANGUAGE LABORATORY SYSTEMS 
Criteria: Final Listening Discrimination Test 

Covariates: 



1. Language IQ 
3. Pre-Exp. LA List 
5. Mid-yr. LB Read 


. Test 
Test 


2. 

4. 

6. 


Mod. Lang. Apt. Test 
Pre-Exp. Coop. Test 
Mid-yr. List. Discrim. 


Test 


CONTRAST 


FRENCH 


(24 


classes) 


GERMAN (25 classes) 




F-ratio 







F-ratio 


P.< 


1. TR vs AA 


.090 




.769 


.263 


.616 


2. TR vs AR 


.250 




.626 


.018 


.896 


3 . AA vs AR 


.210 




.655 


1.135 


.305 


4. TR vs AA at FSG 


2.018 




.181 


.000 


•997 


5. TR vs AR at FSG 


2.778 




.121 


1.128 


.306 


6. TR vs AA at FSM 


I .636 




.225 


.301 


.592 


7. TR vs AR at FSM 


2.07^ 




.175 


.021 


.886 


8. AA vs AR at FSG 


.007 




.933 


1.023 


.329 


9. AA vs AR at FSM 


.144 




.711 


.151 


.704 



TABLE 29 



ANALYSIS OF COVARIANCE BY LABORATORY SYSTEM 
TEN PERCENT RANDOM SAMPLE 
Criteria: Final LB Speaking Test 



Covariates: 

1. Language IQ 3* Cooperative Achievement Test 

2. Mod. Lang. Aptitude Test 4. Pre-Exp. LA List. Test 



CONTRAST 




FRENCH (21 


classes) 


GERMAN (21 


classes) 






F-ratio 


P-i-<i 


F-ratio 


P- ^ 


1. TR vs 


AA 


• 395 


.545 


.013 


.912 


2. TR vs 


AR 


.860 


.378 


.208 


.659 


3 . AA vs 


AR 


.245 


.632 


.265 


.619 



TABLE 30 

ANALYSIS OF COVARIANCE BY LABORATORY SYSTEM 
TEN PERCENT RANDOM SAMPLE 
Criteria: Valette Speech Production Test 



Covariates: 

1. Language IQ 3. Cooperative Achievement Test 

2. Mod. Laxig. Aptitude Test 4. Pre-Exp. LA List. Test 



CONTRAST 




FRENCH (13 
N=27 


classes) 


GERMAN (16 
N=36 


classes) 






F-ratio 


p. < 


F-ratio 


P« ^ 


1. TR vs 


AA 


.492 


.556 


1.226 


.319 


2. TR vs 


AR 


.194 


.703 


.438 


.537 


3 . AA vs 

4. TR vs 


AR 

AA+AR 


5.184 


.131 


1.837 

6.452 


.233 

.052* TR< 
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TABLE 31 



ANALYSIS OF COVARIANCE, TAPE RECORDER vs 
LANGUAGE LABORATORY SYSTEMS 
Criteria: Final LB Reading Test 

Covariates: 



1. Language IQ 
3* Pre-Exp, LA List. Test 
5. Mid-yr. LB Read Test 

CONTRAST FRENCH (24 



F-ratio 



1 . 


TR 


vs 


AA 






.000 


2. 


TR 


vs 


AR 






.452 


3. 


AA 


vs 


AR 






5.599 


4. 


TR 


vs 


AA 


at 


FSG 


5.451 


5. 


TR 


vs 


AR 


at 


FSG 


13.043 


6. 


TR 


vs 


AA 


at 


FSM 


12.973 


7. 


TR 


vs 


AR 


at 


FSM 


.896 


8. 


AA 


vs 


AR 


at 


FSG 


3.998 


9. 


AA 


vs 


AR 


at 


FSM 


.656 



2. Mod. Lang. Apt. Test 
4. Pre-Exp. Coop. Test 
6. Mid-yr. List. Discrim. Test 



classes) 


GERMAN 


(25 classes 


P. 


F-ratio 


P - < 


.986 


1.460 


.247 


• 514 


.703 


.416 


,036*aa>ab 


1.319 


.270 


.038* TB>AR 


.164 


.692 


. 004**TR> AR 


.718 


.411 


. 004**TB< AA 


1.848 


.196 


.363 


.289 


.599 


.069 


1.434 


.251 


.434 


.732 


.40? 



I 



Objective 3 : To determine which variable . or combination 

of variables — I.Q. . total gradepoint average . and appropriate 
prognostic test — best predicts student achievement in foreign 
languages . 

At the end of Level I, multiple regression equations and 
multiple correlation coefficients were developed on French 
and German students. The best overall predictors of success 
in Level I were found to be (l) the Modern Language Aptitude 
Test . (2) the pre-experimental Listening Test and (3) the 
Language I.Q. The preceding English or Social Studies grade 
appeared in some equations. Multiple correlation coefficients 
were significant at the .01 level except for 11th graders 
where they only reached the .05 level of confidence. 

In Project 7-0133 » equations and coefficients were de- 
veloped using pre-experimental measures to indicate probable 
success in foreign language achievement over a two year period. 
These are reported in Table 

The most consistent predictors of achievement in foreign 
language skills were (l) the Modern Language Aptitude Test and 
overall scholastic success as indicated by the student's pre- 
ceding (2) English grade and ( 3 ) Social Studies grade. Lan- 
guage I.Q. and the pre-experimental Listening Test — both found 
to be the best predictors of success for Level I — were not 
as important in predicting achievement over a two-year period. 

The actual weight of each predictor with reference to a 
specific foreign language behavior can be seen in the equations 
of Table 32 . The importance of preceding academic marks may 
well be indicative of overall student motivation toward learning 
within the school environment, regardless of the subject matter 
involved. No motivation measures were taken of the experimental 
students. 
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Objective 4 : To Identify and compare student attitudes 

toward each of the teaching strategies and language laboratory 
systems . 

The assessment of student attitude was based primarily on 
an eighteen item semantic differential scale administered in 
various forms three times each year. The secondary assessment 
was based upon a personal interview with a ten percent randomly 
selected sample of each Project class at the close of the second 
year of French or German instruction. 

The Student Opinion Scale (S.O.S.) asked each student to 
respond to . . . "your impression about the study of French 
(or German) this year.” Students marked from 1 to 7 on eighteen 
sets of polar adjectives. The Scale is reproduced in Appendix F. 

After key punching, each Student Opinion Scale was automati- 
cally scored by computer and analyses of variance computed be- 
tween students in varying treatments. If significance existed 
among various groups, Tukey "A” tests were applied to determine 
the probability of significant differences between particular 
groups. 

Project 5-0683 had indicated a highly significant initial 
difference in student opinion between males and females in both 
French and German and between males studying French and males 
in German. There was a significant decline in student opinion 
from September to January to June. The Opinion Scale correlated 
highly with other measures, both of attitude or expectation and 
of achievement. Project 7-0133 sought to determine if these 
significant attitude shifts would continue during the second 
year of foreign language study. 



CONTINUING VERSUS NON-CONTINUING STUDENTS 

The possibility existed that an initial difference in a 
student's attitude or opinion about foreign language study might 
have influenced the length of study. To assess this possibility, 
a comparison was made of students who completed the two year 
instructional phase of the experiment and those who left the 
Project population (Tables 33 and Jk) . 

Since it was impossible to determine the precise reason for 
each one of the sixteen hundred students "lost” over the two- 
year period, the Non-Continuing groups contain not only true 
"drop-outs" — students who by choice terminated foreign language 
study after one year — but also students who transfered from 
Project classes or for whom some item of data was not obtained 
in Level I. The thirty students who began the second year but 
were dropped from the experiment due to missing data before 
finishing French or German II were eliminated before the 
analysis of variance was computed. 



I 



TABLE 33 

STUDENT OPINION CHANGES 
CONTINUING vs NON-CONTINUING STUDENTS 
At the end of one year of instruction 

Pre-Experimental 

1. French, non-continuing 

2. French, continuing 

3* German, non-continuing 

4. German, continuing 

Post-Experimental 

5. French, non- continuing 

6. French, continuing 

7. German, non- continuing 

8. German, continuing 



N 


Mean 


S.D. 


1017 


5.36 

te 


.76 


372 


5.4 3 


.70 


584 


5.39 


.70 


456 


5.4 3 


.66 


1017 


4.81 


1.17 


372 


5.19 


.98 


584 


4.83 


1.10 


456 


5.31 


.91 



Source 

Between 

Within 



ANALYSIS OF VARIANCE 
df Sm.Sqs. 



7 

4850 



329.71 

3965.37 



Mean Sq. 

47.101 

.817 



F 

57.61 



SIGNIFICANCE OF DIFFERENCES BETWEEN ORDERED MEANS 
Tukey "A M Multiple Range Test 



Groups ; 5. 7. 6. 8. 1. 

4.81 4.83 5.19 5.31 5*36 

5. 

7. 

6 . 

8 . 

7. 

3. 

2 . 

4. _ 

* p. < .05, ** p.^ .01. 



3. 

5.39 



2 . 

5.^3 



4. 

5.44 



4.81 


. 02 . 38 ** 


.50** 


. 55 ** 


.58** 


.62** 


.63** 


4.83 


— . 36 ** 


.48** 


. 53 ** 


.56** 


.60** 


. 61 ** 


5.19 


' 


.12* 


. 17 ** 


.20** 


.24** 


.25** 


5.31 





— 


.05 


.08 


.12 


.13 


5.36 

5.39 


— — — — — — — — 


_ _ _ _ 


“ “ “ “ 


.03 


.07 

.04 


.08 

.05 


5.43 

5.44 


“ ™ ™ ™ — “ 




“ “ ™ “ 


™ ™ ™ ™ 




.01 
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The data reported in the accompanying tables indicates 
that no significant initial differences existed between con- 
tinuing and non-continuing students. As expected, all student 
opinion measures shifted downward at the close of the first 
year of instruction. This overall shift was more marked but 
not significantly higher for German students. The attitude 
indices for non-continuing students contrasted highly to 
those of continuing students at the end of one year of 
foreign language study. 

It is, therefore, impossible to utilize student opinion 
about foreign language study as an indication of later moti- 
vation to continue into Level II. Apparently all students 
have equal aspirations as they undertake foreign language 
study. Attitudes at the end of the first year of study are 
significantly different between those students who continue 
into Level II and those who discontinue foreign language 
study. 



OVERALL OPINION SHIFTS 



Student opinion about foreign language study declined 
throughout the two year instructional period. Table 35 
shows that an initial mean Opinion Scale Index of 5*^3 
existed for both French and German students. This index 
declined significantly to 5*19 and 5* 31 by the end of the 
first year. No resurgence of opinion occurred over the 
summer — the end of the first year and the fall of the second 
year indexes are very close. Attitude declined steadily 
throughout the second year (Table 35)* 

Among students who continued in foreign language study, 
no significant differences occurred between French and German 
population (Table 36). Significant differences had existed 
between the two in Level I. Apparently those male students 
with significantly lower attitude indexes in French dis- 
continued language study. 



TABLE 35 



STUDENT OPINION CHANGES 

ENTIRE EXPERIMENTAL POPULATION, TWO-YEAR PERIOD 
7 Point Scale; l=low, 7=high 



Group 




N 


Mean 


S.D. 






1. French, 


Pre-Exper. 


372 


5.^3 


.70 




n. s. 


2. German, 


Pre-Exper . 


456 


5.^3 


. 66 




3 . French , 

4. German, 


End 1st yr. 
End 1st yr. 


372 

456 


5.19 

5.31 


.98 

.91 




n. s. 


5. French, 

6. German, 


Fall 2nd yr. 
Fall 2nd yr. 


372 

456 


5.15 

5.19 


.94 

.90 




n. s. 


7. French, 


Mid 2nd yr. 


372 


4.87 


.96 




n. s. 


8. German, 


Mid 2nd yr. 


456 


4.97 


1.03 




9. French, 


End 2nd yr. 


372 


4.81 


1.06 




n. s . 


10. German, 


End 2nd yr. 


456 


4.94 


1.05 




Source 


df 


Sm.Sq . 




Mean Sq . 




F 


Between 


9 


184. 


71 


20.52 




23.85** 


Within 


4130 


3558. 


72 


.86 






SIGNIFICANCE OF 


DIFFERENCES BETWEEN MEANS 








Tukey "A" 


Multiple Range 


Test 






Group : 9 


7 10 


8 5 


6 


3 


4 


1 


Mean: 4.8l 4.87 4.94 4 


.97 5.15 


5*19 


5.19 5. 


31 


5.43 


9. 4.81 — 


- .06 .13 


.16 .34 


** .38** .38** . 


50** . 62** 



7. 4.8? .07 .10 .28** .32** .32** 

10. 4.94 - 03 .21** .25** .25** 

8. 4.97 18** .22** .22** 

5. 5.15 .04 .04 

6. 5.19 .00 

3. 5.19 - - 

2. 5. ^3 



.44** .56** .56** 

.37** .49** .49** 

.34** .46** .46** 

.16 .28** .28** 
.12 .24** .24** 

.12 .24** .24** 

.12 .12 

.00 



P. < .05. ** p.< .01 
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TABLE 36 



STUDENT OPINION CHANGES 
French vs German, Two-Year Period 



Group 




N 


Mean 


S.D. 


1. French, 


Pre- experimental 


372 


5.93 


.70 


2. German, 


Pre- experimental 


956 


5.99 


. 66 


3. French, 


End 1st year 


372 


5.20 


.98 


4. German, 


End 1st year 


956 


5.31 


.91 


5. French, 


Fall 2nd year 


372 


5.15 


.94 


6. German, 


Fall 2nd year 


956 


5.19 


.90 


7. French, 


Mid 2nd year 


372 


9.87 


.96 


8. German, 


Mid 2nd year 


956 


9.97 


1.03 


9. French, 


End 2nd year 


372 


9.81 


1.06 


10. German, 


End 2nd year 

ANALYSIS OF VARIANCE 


956 


9.99 


1.05 


Source 


df Sm.Sqs. 


Mean Sq . 




F_ 


Between 

Within 


9 — 189.97 

9130 3559.53 


20.55 

.86 


1 

CM 


.88** 



SIGNIFICANCE OF DIFFERENCES BETWEEN ORDERED MEANS 
Tukey "A" Multiple Range Test 



Groups: 9* 7« 10. 8. 5* 

4.81 4.87 4.94 4.97 5.15 

9. 4.81 .06 .13 .16* .34** 

7. 4.87 .07 .10 .28** 

10. 4.94 .03 .21** 

8. 4.97 .18** 



5. 5.15 

6. 5.19 

3. 5.20 

2. 5.44 

* p.<.0 5, ** P.< .01. 



3. . 


4. 


1. 


2. 


19 5.20 


5.31 


5.^3 


5.44 


38** .39** 


.50** 


.52** 


.53** 


32** .33** 


.44** 


.56** 


.57** 


25** .26** 


.37** 


.99** 


.50** 


22** .23** 


.34** 


.96** 


.47** 


O 

• 

-d“ 

0 


.16* 


.28** 


.29** 


• 01 


.12 


.29** 


.25** 


— 


.11 


.23** 


.24** 


— 


— 


.12 


.13 


— — _ _ _ _ 


_ _ _ _ 


_ — _ — 


.01 



- 80 - 




STUDENT OPINION CHANGE BY STRATEGY 



The primary goal of Objective 4 was to determine if varying 
teaching strategies influenced student attitude toward foreign 
language study. No significant differences had been observed in 
Level I, Project 5-0683. 

With the reduced number of students in Level II and the re- 
moval of students who had not continued from the experimental 
population, several significant differences in student attitudes 
between strategies did emerge. Table 37 shows that at the end 
of Level I in French those "Functional Skills Method" students 
who continued into Level II had a significantly higher attitude 
than their counterparts in "Traditional" classes. This advantage 
disappeared by the close of Level II. 

In German (Table 38 ) significant differences, FSG>TLM, oc- 
curred at the end of Level I but reversed to become nonsignificant 
TLM = FSG, at the end of Level II. However, by the end of Level 
II the pure "Functional Skills" approach students had a signifi- 
cantly poorer opinion of foreign language study than the "Func- 
tional Skills + Grammar" students. 



TABLE 37 



STUDENT OPINION CHANGES 
BY STRATEGY: FRENCH 



7 Point Scale: l=low, 7=high 



Group 


N 


Mean 


S.D. 


P- < 


1. TLM, 


Pre-Exp. 


41 


5. **5 


.66 




2. FSG, 


Pre-Exp. 


232 


5.39 


.72 


n. s. 


3. fsm, 


Pre-Exp. 


99 


5.51 


. 68 




4. TLM, 


End 1st yr. 


41 


4.99 


.97 V 




5. FSG, 


End 1st yr. 


232 


5.12 


1.04 > 


.05 


6. FSM, 


End 1st yr. 


99 


5.^6 


.7 ?/ 




7. TLM, 


End 2nd yr. 


41 


4.61 


1.00 




8. FSG, 


End 2nd yr. 


232 


4.87 


1.11 


n.s. 


9. fsm, 


End 2nd yr. 


99 


4.76 


.98 




Source 


df 


Sm . S q . 




Mean Sq. 


F 


Between 


8 


85.81 




10.73 


12.53** 


Within 


1107 


947.55 




.86 





SIGNIFICANCE OF DIFFERENCES BETWEEN MEANS 



Tukey "A" Multiple Range Test 



Group : 7 


9 8 4 


5 


2 


1 


6 


3 


Mean: 4.6l 


4.76 4.87 4.99 


5.12 


5.39 


5.45 


5.46 


5.51 


7 . 4.61 — 


.15 .26 . 38 * 


. 51 ** 


.78** 


.84** 


.85** 


.90** 


9. 4.76 — 


.11 .23 


.36 


. 63 ** 


. 69 ** 


.70** 


.75** 


8. 4.87 


.12 


.25 


.52** 


. 58 ** 


.59** 


.64** 


4 . 4.99 — 




.13 


.40* 


.46** 


.47* 


.52** 


5 . 5.12 — 






.27 


.34 


.35 


.39 


2 . 5.39 — 






— 


.06 


.07 


.12 


1. 5 . 1*5 — 






— 


— 


.01 


.06 


6. 5.46 

3. 5.51 

* p. <-05, 


** p.< . 01 . 










.05 
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TABLE 38 



STUDENT OPINION CHANGES 
BY STRATEGY : GERMAN 



7 Point Scale: l=low, 7=high 



Group 




N 


Mean 


S.D. 


P- <_ 


1. TLM, 

2. FSG, 

3 . fsm, 


Pre-Exp. 

Pre-Exp. 

Pre-Exp. 


105 

1*5 

206 


5.35 

5.53 

5.^1 


.70 

0 66 

.64 


n. s. 


4. TLM, 

5. fsg, 

6. FSM, 


End 1st yr. 
End 1st yr. 
End 1st yr. 


105 

1*5 

206 


5. 16 

5. 45 

5.27 


.88 V 

.88 X 

*95 


.01 


7. TLM, 

8. FSG, 

9 . fsm, 


End 2nd yr. 
End 2nd yr. 
End 2nd yr. 


105 

1*5 

206 


5.03 
5.13 
4. 75 


*94 

.89 \ 

1.17 / 


.01 


Source 


df 




Sm.Sqs. 


Mean Sq. 


F 


Between 

Within 


8 

1359 




82.11 

1062.31 


10.26 

.78 


13.1*** 




SIGNIFICANCE 


OF DIFFERENCES BETWEEN 


MEANS 






Tukey 


"A” Multiple Range Test 






Group : 


9 7 


8 


4 6 


1 3 


5 2 



Mean: 


4.75 


5.03 


5.13 


5.16 


5.27 


5.35 


5.41 


5. *5 


5.53 


9. 4.75 


— — 


.28** 


.38** 


.41** 


. 52** 


.60** 


.66** 


.70** 


.78** 


7. 5.03 


- 


— 


.10 


.13 


0 24 


.32** 


.38** 


.43** 


.50** 


8. 5-13 


— — — ~ 


— 


— 


.03 


.14 


.22 


.28 


.32* 


.40** 


4. 5.16 










— 


,11 


.19 


.25 


.29** 


.37** 


6. 5.27 


-- 


— 


— 


— — 


, 


.08 


.14 


.18 


.26 


1. 5-35 


— — — _ 


— — — — 


— — — — 


— 


— 




.06 


,10 


.18 


3. 5.41 


— 


— 


— ~ 


~~ 





— 


— 


.04 


.12 


5. 5. 45 




1U — w mkmm 







_ — . 





— — — — 


— 


.08 



2, 5.53 

* p.< .05, ** P.< .01. 
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ATTITUDE DIFFERENCES BETWEEN SEXES 



Throughout the experiment there were significant differences 
in both achievement and attitude between male and female students. 
This phenomenon occurred more frequently among French students 
than German students as shown in Tables 6l through 66 (Appendix F.). 
A significant difference in attitude indexes between sexes exis- 
ted throughout in French but not in German. 

When analyzed by both strategy and sex, Table 39 » several 
significant differences appear. These seem almost random, FSM^ 

TLM for French females after one year but not two, Initial 
differences existing between FSG> TLM which lasted one year but 
not two among German males and TLM German females having a 
significantly better attitude than FSM students after two years. 

An analysis was completed by language laboratory type, TR 
versus AA versus AR within each of the "Functional Skills" 
strategies but failed to reveal any significant influences of 
laboratory type on student opinion. The only significant dif- 
ferences occurred initially and were constant over the two-year 
instructional period. In essence, neither the strategy nor the 
system had any discemable effect on student attitude toward 
foreign language study. 
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STUDENT INTERVIEW 



At the close of the instructional phase of Project 7-0133 
a random ten percent sample of the student population was 
given a brief personal interview to assist in assessing 
Objective 4, "To identify and compare student attitudes..." 

The two-hundred and fifteen French and German students 
represent secondary classes throughout Pennsylvania, inclu- 
ding urban, suburban and rural schools of varying sizes and 
diverse geographic settings and are considered to be represen- 
tative of the typical secondary school student. Below is a 
compilation of the student responses in terms of both numbers 
and percentages. 

Conducted by extra-Project persons outside the foreign 
language classroom — to permit disassociation from either the 
Project Staff or participating teachers — the interview was 
designed to gain insights into student attitudes and moti- 
vations relating to the study of modern foreign languages. 
Developed by Dr. Abe Kramer, a specialist in guidance and 
counseling at West Chester State College, questions were 
phrased in the students' language to elicit the most free 
responses. These free responses were then noted by the 
interviewers in terms of "Key" words which were reduced to 
numerical categories for comouter analysis. 



PROJECT 7-0133, STUDENT INTERVIEW (N=215) 



Primary Reason Secondary Readon 



1. How did you come to take a foreign language ? 



college entrance 109 - 50*7$ 10 

local school requirement 36 - 16.7$ 10 

personal interest 41 - 19*1$ 27 

parental wishes 4 - 1.9$ 

to gain insight, understanding 3-1*4$ 5 

miscellaneous other 11 - 5*1$ 156 



4.7$ 

4.7$ 

12 . 6 $ 

2.3$ 

72.6$ 



2. What made you decide on French/German ? 



family background 
general preference 
previous contact 
felt important, useful 
limited language selection in 
particular school 
FLES experience 
peers' advice 

to be different from peers 
miscellaneous other 
no particular reason 



49 - 


22.8/6 


9 - 


4.2# 


41 - 


19. 1# 


29 - 


13-5# 


37 - 


17 . 2 % 


3 - 


1.4# 


24 - 


11 . 2 % 


14 - 


16.5# 


18 - 


8.4# 


6 - 


2.8# 


9 - 


4.2# 


1 - 


• 5# 


12 - 


5.6# 


3 - 


1.4# 


10 - 


4.7# 


1 - 


• 5# 


13 - 


6.0# 


29 - 


13-5# 


2 - 


• l# 


138 - 


64. ->< 



3. If you had to do It over again would you make the same 
choice? 



Yes 170 - 79.1* 
Yes, with qualifications 8 - 3-7* 
No 36 - 16.7* 
no response 1 - «5* 



4. How do you feel you are getting along in a foreign language ? 



Excellent 

Good 

Average 

Poor 

Failing 

no response 



21 - 79.8# 

90 - 4l.9$ 
66 - 30.7# 
26 - 12.1# 

none 

6 - 2 , 8 * 



5. How do you feel about the way French/German is being taught 
to you ? 

Liked method 114 - 53 »0* , 

Neutral or mixed feelings 47 - 21.9* 

Disliked method 48 - 22.8* 



Why do you like or dislike the method? 



likes audio-visual aspects 
likes traditional aspects 
finds FL easy 
finds FL boring 
likes or dislikes teacher 
general satisfaction 
miscellaneous other 
no explanation 



11 - 


5.1# 


2 - 


.9# 


50 - 


23.3# 


12 - 


5.6# 


17 - 


7.9# 


• 6 - 


2.8# 


17 - 


7-9# 


4 - 


1 . 9 # 


26 - 


12.1# 


2 - 


.9# 


60 - 


27.9# 


36 - 


16.7# 


13 - 


6.0# 


11 - 


5 .1# 


21 - 


9.8# 


152 - 


66 • 0# 



Sixteen students gave a third reason for liking or disliking 
the way in which they were taught. 



6. Have you benefited from studying a foreign language ? 



Yes 

No 

no explanation 



189 - 87.9* 
20 - 9 . 3 * 
6 - 1 . 8 * 



7 . Do you have any ideas that might benefit other students 
who may take a course such as yours ? 



pay attention in class 
study harder 
miscellaneous other 
no ideas 



32 - 14.9# 
75 - 34.9# 
13 - 6 . 0 # 
94 - 43.7# 



9 - 4 . 2 # 

12 - 5 - 6 # 

15 - 7.0# 

175 - 81.4# 



8. Do you have any Ideas on how to Improve the wav that you 
were taught? 



more traditional emphasis 


54 


- 


8 - 


3.7# 


more cultural emphasis 


12 


- 5.6# 


2 - 


.9# 


more audio-visual aspects 
more functional skills 


10 


- 4.7# 


3 - 


1.4# 


emphasis 


15 


- 7.0# 


5 - 


2.3# 


slower coverage 


2 


- .9# 


2 - 


.9# 


miscellaneous other 


18 


- 8.4# 


9 - 


4.2# 


no ideas 


97 


- 45.1# 


186 - 


86.5# 



9* After high school do you expect to continue to study 
French /German ? 

Yes 100 - 46.5# 

Yes, with qualifications 15 - 7.0# 

No 73 - 34.0# 

Undecided 22 - 10.2# 

no response 5 - 2.3# 



10. Do you think you will ever make use of it (the foreign 
language ) ? 



for travel 
in college 

in vocation or profession 
to converse w iKi natives 
for reading 
No, unlikely use 
miscellaneous other 
no response 



79 - 


36 . 7 # 


11 - 


5 . 1 # 


28 - 


13 . 0 # 


3 - 


1 . 4 # 


20 - 


9 . 0 # 


8 - 


3 . 7 # 


16 - 


7 . 4 # 


7 - 


3 . 3 # 


13 - 


6 . 0 # 


18 - 


8 . 4 # 


39 - 


18.1# 


6 - 


2 . 8 # 


12 - 


5.6# 


7 - 


3 . 3 # 


8 - 


3-7# 


155 - 


72 . 1 # 



I 



11 , If there were no requirement to take a foreign language 
(for graduation or college admission, etc.) and you had 
a free choice of subjects, indicate the three subjects 
you would choose . 





First 


choice 


Second 


choice 


Third 


choice 


Art 


15 - 


7 . 0 % 


14 - 


6.55*; 


21 - 


9.8$ 


English 


54 - 


25 . 1 % 


39 - 


18.1$ 


29 - 


13-5$ 


Foreign Language 


31 - 


14.4$ 


58 - 


27.0% 


44 - 


20 . 5 % 


Mathematics 


38 - 


17 . 7 % 


4l - 


19 . 1 % 


32 - 


14.9$ 


Science 


41 - 


19 . 1 % 


33 - 


15*3$ 


29 - 


13-5$ 


Social Studies 


29 - 


13 . 5 % 


25 - 


11.6$ 


49 - 


22.8$ 


miscellaneous other 


4 - 


1 . 9 % 


2 - 


.9$ 


8 - 


3.7$ 


no response 


3 - 


1.4$ 


3 - 


1.4$ 


3 - 


1.4$ 



Why did you choose these three subjects ? 



for college pre- 




paration 


6 - 


vocational purposes 


50 - 


student interest 


65 - 


easy, academic success28 - 


self-improvement , 




useful 


51 - 


general preference 


9 - 


miscellaneous other 


2 - 


no explanation 


1 - 


no response 


3 - 



2.8$ 


7 


- 3.3$ 


3 


23.3$ 


8 


- .8$ 


5 


30.2$ 


70 


- 32.6$ 


70 


13.0$ 


22 


- 10.2$ 


11 


23.7$ 


65 


- 30.2$ 


58 


4.2$ 


25 


- 11.6$ 


46 


.9$ 


5 


- 2.3$ 


7 


.5$ 


10 


- 4.7$ 


12 


1.4$ 


3 


- 1.4$ 


3 



1 . 4 * 

2.3$ 

32.6% 

5 . 1 % 

27.0% 

21.4$ 

3 . 3 % 

5 . 6 % 

1.4$ 



The student interview permitted fresh and even humbling 
insights into student perceptions concerning the study of 
modern foreign languages in the public schools. Item 1 
indicated that two-thirds of the students took a foreign 
language to satisfy real or perceived curricular requirements. 
Secondarily came a personal election while the influence of 
parents or a need to "understand" other peoples was not per- 
ceived by students as an important factor in their under- 
taking foreign language study. 

The decision concerning which language to study (Item 2) 
was influenced by more factors, the most important being some 
prior contact either through the family or in other ways 
including elementary school experiences. A number felt that 
they had no alternative language due to the curricular limi- 
tations of their particular school. Peer pressure at this 
level of maturity worked about equally in both directions. 
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At the close of Level II, over eighty percent of the 
students interviewed indicated that they would make the same 
choice given a second chance (Item 3). Most students 
thought they were doing well in language study (Item 4 ) and 
none admitted to failure although Project teachers indicated 
that some of their poorest students were chosen for the 
random sample . 

Items 5 and 8, concerning student attitude toward the 
teaching strategy, are treated in detail in subsequent 
paragraphs. Few students would offer concrete suggestions 
to benefit other students (Item 7 ). 

About one half of the interviewees planned to continue 
foreign language study after high school, reflecting college 
aspirations (Item 9 ) but few students perceived any real 
definite use for the foreign language (Item 10). Future uses 
perceived are scattered with almost one-fifth simply not 
forseeing any future utilization of the foreign language. 

Few students ever anticipated communicating with native 
speakers of the language beyond use in "travel" situations. 

Students seemed to prefer foreign language study (Item 
11a). When asked to choose any three school subjects they 
would prefer if all. curricular restrictions were removed, the 
foreign language was usually one of the three selected. It 
must be remembered, however, that the students interviewed 
did not represent the entire school population since they 
were completing a successful two-year foreign language experi 
ence. The influence of college was not entirely removed by 
the wording "If there were no requirement..." for immediately 
after choosing the three preferred subjects, students were 
asked why they made the choice they did. A number indicated 
that they still made their decision based on preparation 
for college. 



STUDENT EVALUATION OF TEACHING STRATEGIES 



The hypothesis is often assumed that students learning a 
modern foreign language via a functional skills approach are 
discontented with the teaching strategy or, conversely, that 
students seem to "enjoy" this approach more than others. 
Fourteen traditional, twenty-one functional skills and thirty 
nine "combination" classes were represented in the interview 
sample. It is felt that the random selection, the diverse 
schools, and the number of differtxit teachers represented 
in each teaching strategy were enough to off-set uncontrolled 
variables and to permit an assessment of student attitude 
toward each teaching strategy. 



The students were asked to respond, in an unstructured 

answer, to the question, How do you feal about the way a 

foreign language is being taught to you ? (Item 5)* Inter- 
viewers then marked the reaction as Like* Dislike or 
"Mixed.” Two hundred and nine students responded to the 
question. Data on the responses were tabulated and arranged 
for statistical tests of significance. Responses were as 
follows : 



TABLE 40 



STUDENT REACTION TO 


TEACHING 


STRATEGY 




Assigned Strategy 


Like 


Mixed 


Dislike 


Traditional: 


French - 6 classes 


13 


2 


1 


German - 7 classes 
Functional Skills + Grammar 


12 

• 

# 


2 


7 


French - 25 classes 


35 


18 


13 


German - 14 classes 


16 


9 


9 


Functional Skills: 


French - 6 classes 


15 


8 


8 


German - 15 classes 


23 


8 


10 



It can be clearly seen that over fifty percent of the 
students indicated that they liked the way they were learning 
a foreign language while about one quarter were either un- 
decided or disliked their strategy. Still unanswered was the 
question concerning the significance of student dissatisfaction 
within each treatment, was the proportion of dissatisfied stu- 
dents the same within each strategy or did the proportion vary 
significantly for one treatment? A Contingency Table was 
developed and expected cell values computed. Differences of 
student responses from the expected number of responses were 
then assigned values of Chi Square. 



I 

i 



TABLE 4l 

CONTINGENCY TABLE, TEST OF INDEPENDENCE (N209) 



Cell 


Expected 


Observed 


Cell Value 


TLM: like 


20.2 


25 


1.14 


: mix 


8.3 


4 


2.23 


: dislike 


8.5 


8 


.03 


FSG: like 


54.5 


51 


.22 


: mix 


22.5 


27 


.90 


: dislike 


23.0 


22 


.04 


FSM: like 


39.3 


38 


.04 


: mix 


16.2 


16 


_ _ _ 


: dislike 


16.5 


18 


.14 



Chi Square = 4.74 at 4 d.f. 



The value of Chi Square required for significance with 
four degrees of freedom is 9*49. There is therefore no grounds 
for rejecting the independence of student evaluation of his 
strategy and the strategy itself. 

The major portion of the value of Chi Square clearly 
lies in the "traditional" cells with more students prefering 
this strategy than were expected. Further refinement was not 
necessary but for informative purposes separate Contingency 
Tables were computed for German and French students. For 
German students (N 96 ), Chi Square equalled 8 . 28 , insignificant, 
indicating again that in the seventy-three classes represented 
there was no significant relationship between the strategy 
employed and the students* evaluation of it. 

To further test the hypothesis that functional skills stu- 
dents prefer a more traditional course, an examination was 
made of the responses to, " What advice would you give to im - 
prove the way that you were taught a foreign language ?" ( Item 8 ) . 
Many responses were given but of most direct interest were 
those of "Functional Skills" students, preferring more of the 
"traditional" skills (formal grammar, reading, writing or 
translation) or "Traditional" students preferring more stress 
on functional skills (speaking, conversation). These are 
shown in Table 42 . 
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TABLE 42 

STUDENT ADVICE ON TEACHING METHOD 
Assigned Strategy More Traditional More Functional Skills 



Traditional 


1 


5 


Functional-Skills 
+ Grammar 


35 


7 


Functional Skills 


18 


5 


Several conclusions 


are obvious. 


Among these are that 



a minority of the total sample of 215 students wanted their 
class to assume the characteristics of the "other" strategy. 
Educators who maintain that students desire more aspects of 
one strategy or another may be failing to recognize the basic 
human desire to emulate others, the "grass is always greener" 
drive or the student rationalization that he could achieve 
more if the instruction were different. 
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Objective 5 : To identify levels of foreign language mastery 

that ~ are attainable in the secondary school language program . 

Levels of mastery attainable in the typical secondary 
school program are definable in terms of progress through a 
series of materials and in achievement on standardized measures. 
Both definitions are useful, one in setting realistic and 
attainable curriculum goals and the other for comparison of a 
particular class with a larger "parent" population. 



TEXT COVERAGE 



At the close of the second year of the instructional phase 
of the experiment, teachers in both original project classes 
and in the replicating classes reported their progress through 
their assigned materials. Early in the experiment minimal levels 
had been established below which students were not to be tested. 
No other restriction upon progress had been imposed although 
recommendations had been stated in the guidelines. 

Since every foreign language class seems to have its own 
dlst^\cc personality, progress through the materials was ir- 
regular. However, the Project classes were considered typical 
of those in secondary public schools throughout Pennsylvania. 

The reported amount of material covered by teachers serves to 
confirm the empirical findings of many foreign language edu- 
cators that text book authors imply too high a rate of progress 
for the average class. The material covered in both Level I 
and Level II classes is illustrated in Table 43 • 

The majority of German classes in the audio-lingual or 
functional skills orientated materials completed just a little 
more than the first bock in two years of instruction in the 
typical high school setting. In the materials published by 
Holt, Rhinehart and Winston, beginning German classes seemed 
able to complete only to about Unit 13 in one year of instruc- 
tion and to Unit 6 of the second year book at the end of two 
years * In the Aud i o-Lingual Material, German classes finished 
Units il or 12 at the end of one year of instruction and Units 
17 to 18 by the end of the second year. In French the situation 
is very similar but with slightly less progress. In the Hole 
materials classes finished about Unit 13 and in the Aud 10 -Lingual 
Materials, French about Units 10 or 11. In secon J year French 
there was more of a spread in the Audio-Lingual aerials but 
most classes seem to cluster from Units 15 to 19 while in the 
Holt materials one class was just finishing the first level book 
and most others had only reached Unit 2 or 3 of the second year 
book at the end of two y ;ars instruction. 





TABLE 43 



UNITS/CHAPTERS COMPLETED 



Text 



Unit (Number of Classes) 



German Is 



A First Course in German 

Audi o -Lingual Materials , German 

Verstehen und Sprechen 



29 (1) 

11 (3), 12 (3) 

10 (1), 13 (1), 19 (1) 



German II: 

A Second Course in German 
Audio -Lingual Materials . German 

Verstehen und Sprechen 
Sprechen und Lesen 



14 


(1), 


22 


(1), 


23 


(1), 


24 


(2) 


15 


(2), 


16 


(1), 


17 


(4), 


18 


(3) 


21 


(2), 


22 


(1) 










20 


(1) 














2 


(1), 


3 


(1), 


6 


(1), 


12 


(1) 


14 


(1) 















French Is 



New First Year French 
Parlez-Vous Francals ? 

Audio -Lingual Materials . French 
Ecouter et Parler 



30 (2) 

55 (1) 

9 (2), 10 (4), 
12 ( 1 ), 13 ( 2 ), 



11 (4), 12 (1) 
17 (1) 



French II: 

New Second Year French 

Cours Moyen de Francais 

Oui . Je Parle Francals 

Audio -Lingual Materials . French 

Ecouter et Parler 
Parler et Lire 



24 


(1), 


33 


(1) 










17 


(1) 














34 


(1) 








(1), 




(4) 


14 


(1), 


15 


(2), 


16 


17 


19 


(2), 


21 


(2), 


22 


(1) 






20 


(1) 












(1) 


2 


(3), 


3 


a), 


6 


(1), 


7 
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ESTABLISHMENT OF PROJECT NORMS 



The tendency exists in educational evaluation to compare 
the achievement of one individual or group with that of an- 
other. Publishers of standardized tests have long developed 
and published "norms" on various instruments to permit the 
comparison of students to regional or national standards. 

While every effort is made to develop norms on representative 
and widely scattered populations, those selected may not be 
typical of the students in a particular locality or region. 

The comparison of the achievement of Project classes on 
the MLA Cooperative Classroom Tests with the: norms published 
by the Educational Testing Service revealed some differences. 
This led to the development of "Project" or "Pennsylvania" 
norms based upon the achievement of Project students. The 
complete norms for Levels I, II and III on the MLA Cooperative 
Classroom Listening and Reading Tests are reproduced 6*1 pag6s 
G-l through G- 10 , Appendix G. In several cases "Project" popu- 
lations exceeded the national sample utilized by the Educational 
Testing Service and, in the case of Pennsylvania, may represent 
a more "representative" cross-section of schools. 



COMPARISON OF ACHIEVEMENT BY GRADE 



At the conclusion of Level I, Project 5 - 0683 , an attempt 
was made to determine if significant differences in achievement 
had occurred among students in various grades. None did. 
However, it was reasoned that since the emphasis on the reading 
and writing skills increased in Level II, the analysis would 
again be viable. 

Analyses of variance were computed among students grouped 
within particular grade levels. The assumption was made that 
such grouping randomly compensated for differences in sex, 
intelligence and aptitude, although empirically it was felt 
that more able students generally have the opportunity to 6lect 
a two year foreign language sequence earlier than their less 
able peers „ 

The mean achievement of students by grade is shown in 
subsequent tables in Appendix E. Throughout, students in the 
earliest grade achieved significantly less than students who 
began later. While some differences of pattern exist among 
the ranking of group means on Tables 35 through 56, grades 8 
and 9 remain consistently low on both the Listening and Reading 
Tests and in both French and German . This consistent low 
placement of earlier grades led to an examination of the 
replication population by grade (Tables 57 through 60, Appendix 
E). The same phenomenon existed in all four analyses, eighth 
grade lowest. In seven of the eight analyses significant dif- 
ferences between grades existed at the .01 level of confidence 
on the Tukey "A” multiple range test. Patterning is illustrated 
in Table 



TABLE 

ORDER OF GRADES BY MEAN ACHIEVEMENT 





Rank 


order 


of 


Group Means 


Significance 


of Differences 


Listening 


Low 






High 


Tukey 


"A" 


French I 


9 


11 


12 


10 






French II 


9 


10 


12 


11 


P. < 


.01. 


German I 


9 


12 


10 


11 


p. < 


.01. 


German II 


9 


10 


12 


11 


p.< 


.01. 


Reading 


French I 


8 


10 


9 


11 


p. < 


.01. 


French II 


8 


9 


11 


10 


P. < 


.01. 


German I 


8 


9 


11 


10 


p*4 


.01. 


German II 


8 


10 


9 


11 


P-4* 


.01. 
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Objective 6 : To determine the strengths and weaknesses of 

selected commercial programs . 

Since it was impossible to divorce text from strategy in 
the experiment, it was of interest to compare the possible 
effect of a particular text within a particular strategy. 
Essentially only one text was used in the "Traditional” classes, 

A First (Second) Course in German by Huebener and Newmark and 
Cours Elementaire (MoyenT~ de Francois by Dale and Dale. Only 
one traditional French class used Psrlez-vous Francais ? and 
Oui, Je Parle Francais by Huebener and Newschatz. In the 
" Functional Skills " strategies, however, classes were divided 
more equally between two series, the Audio -Lingual Materials 
and the Holt, Rinehart Winston Ecouter et Parler — Verstehen 
und Sprechen texts. 

Enough students utilized each text to permit a comparison 
of the influence of the text employed on final test scores, 
a measure of both a possible influence on achievement and a 
possible compatability of one text series with the criterion 
MLA Cooperative Classroom Tests . Student scores on final tests 
from thirteen French and thirteen German classes using the 
ALM were compared with three hundred students from five French 
and seven German classes studying the Holt materials. Critical 
Ratios were computed to determine if significant differences 
existed between the two groups of students (Table 45). 

Significant difference 0 in final achievement scores occurred 
on two of the six measures in French. In German four of the 
six measures revealed significant differences. All but one 
significant difference in both languages favored the Holt, 
Rinehart and Winston materials. This supported the equivalent 
comparison illustrated on page 103 of the final report of 
Project 5-0683, 



* * 
f t 

* I 



4 

1 

1 
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TABLE 45 



COMPARISON OF ACHIEVEMENT BY TEXT, 
FUNCTIONAL SKILLS I vs. FUNCTIONAL SKILLS II 



Audio-Lingual Ecouter et 
FRENCH, Materials. N=255 Parler. N=15». 



Post-Exp. Tesfcfes 


Mean 


S.D. 


Mean 


S.D. C.R. 


1. List. Discrim. Test 


48.46 


9. 54 


48.90 


9.14 .47 


2. LB Listening Test 


19.93 


8.00 


23.77 


8.02 4.70** 


3 . LB Reading Test 


20.58 


7.75 


20.79 


9.11 .25 










N=22 


4. LB Speaking Test 


32.33 


9.86 


30.00 


12.52 .74 


5. LB Writing Test 


41.39 


20.41 


28.91 


21.42 2.16* 


6. Sound Production Test 


43.24 


30.96 


40.91 


31.07 .27 



GERMAN, 


Audio-Lingual 
Materials .N -291 


Verstehen und 
Sprechen,N=l 47 




Post-Exp. Tests: 


Mean 


S.D. 


Mean 


S.D. 


C.R. 


1 . List. Discrim. Test 


44.22 


11.09 


47.59 


7.52 


3.75** 


2 . LB Listening Test 


17.57 


7.57 


23.39 


0^ 

00 

• 

00 


2.43* 


3. LB Reading Test 


15.27 


6.05 


19.40 


7.66 


5.70** 


4 . LB Speaking Test 


33. CO 


9.07 


N =19 

37.16 10.88 


1.42 


5. LB Writing Test 


41.37 


18.11 


51.53 


24.07 


1 . 6 l 


6 . Sound Production Test 


58.60 


30.55 


71.63 


7.29 


2 . 40 * 



* p.< .05, ** P. <.01. 
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Objective 7* To identify teacher factors related to student 
achievement . 



One of the most surprising conclusions of Project 5-0683 
was that there existed no direct relationship between teachers' 
scores on the Modern Language Association Proficiency Tests for 
Teachers and Advanced Students and the scores of their classes 
on standardized foreign language achievement tests. The further 
study of this phenomenon was considered a priority in analyzing 
the data from Project 7-0133. The question of the relationship 
of teacher attitude to both student attitude and student achieve- 
ment was also considered important. 

Much information was available on the Project teachers in- 
cluding the criteria most commonly utilized for teacher advance- 
ment, years of experience and formal graduate education. All 
available were the class size, the number of years of experience 
teaching the foreign language and teacher self-estimates of 
foreign language ability. All of these were statistically 
analyzed to determine if they were significantly related to the 
achievement of a modern foreign language class after one 
semester, one or two full years of instruction from the same 
teacher. 

Table A6 illustrates tne background of the forty class- 
room teachers who maintained the same class for the two-year 
experimental period. In the main, the teachers seemed to be 
well prepared by existing criteria, averaging ten to eleven 
years experience and having a considerable quantity of formal 
graduate education. Comparison of the scores obtained on 
the MLA Teacher Proficiency Tests with the published national 
pre-institute percentiles indicates that the teachers are 
fairly representative of the profession. 

The relationship of both teacher background and teacher 
proficiency scores to class achievement was computed by a 
standard correlation program. Values of the correlation co- 
efficient obtained were assigned levels of significance based 
upon a standard table after Fisher and Yates with N-2 degrees 
of freedom. The coefficients are reported in Tables A 7 an d A 8* 

It can be seen that almost none of the teacher proficiency 
factors tested seems to have any systematic relationship to 
student achievement with the possible exception of some 
significant relationship to the "listening" skills among the 
nineteen French classes after one, two or four semesters. 

This same relationship was not apparent at the end of one or 
two semesters when the same nineteen teachers were included 
in the larger (N-5?.) comparison reported for Project 5-0683 
nor did occur in German. 



Also included in the relationship study was the class 
mean on the Student Opinion Scale after two years of modern 
language study. No relationship existed between any teacher 
variable and the class attitude toward foreign language study. 



TABLE 46 



MEAN TEACHER MEASURES AND PROFICIENCY SCORES 





French , 


N=19 


German, 


N=21 


1. Graduate Semester hours: 


36.42 




44.48 




2. Yrs. teaching experience: 


9.95 




10.86 




3. Yrs. for. lang. teaching 


6.84 




7.52 




MLA Teacher Proficiency Tests: 


Nat *1 
%-ile 




Nat *1 
^-ile 


4 . Speak 


37.74 


50-55 


41.81 


60 


5. Listen 


71.00 


60 


88.52 


65-70 


6. Read 


45.47 


60 


52.00 


65-70 


7. Write 


44.42 


55 


57.00 


65-70 


8. Applied Linguistics 


49.68 


70-75 


52.81 


70-75 


9. Culture 


47.11 


65 


53.62 


70-75 


10. Professional Preparation 


63 . 26 


60 


62.29 


55 
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RELATIONSHIP OF TEACHER FACTORS AND CLASS ACHIEVEMENT 
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TEACHER OPINION MEASURES 



Prior to the commencement of the Project during the 1965 
pre-experimental workshop, teachers were asked to respond to 
a semantic differential scale relating to the way in which 
they viewed their teaching of French or German the previous 
year. The scale itself, reproduced in Appendix F, was that 
used throughout the experiment by Project students but com- 
pleted with reference to the question, "The way I taught 
French/German this past year." 

• 

At the Spring, 1967, evaluation meeting at the close of 
the two-year experimental period, the teachers again responded 
to the same Opinion Scale 0 The scales were scored and analyzed 
for significance between various groups of teachers; teachers 
who completed one year, those finishing two years, and new 
replicating teachers. Comparisons were also made across 
languages. 

Means and standard deviations for these several groups 
are reported in Table 49 . An analysis of variance indicates 
no significance existed between the various groups of teachers' 
concept of their own way of teaching over either the two-year 
time span or between French or German. The teachers always 
conceived their teaching as more "exciting," "alive," "necessary" 
and "rewarding" than "dull" or "unimaginative." 
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TABLE 49 



TEACHER OPINION INDICIES, TWO-YEAR PERIOD 



7 Point 


Scale : 


l=low, 


7=high 






Teacher Group 




Number 


Mean 


S.D. 


Pre -Instructional: 












German tchrs. who 


taught 1 


yr. 


20 


4.98 


1.22 


German tchrs. who 


taught 2 


yrs. 


21 


5.49 


.90 


French tchrs. who 


taught 1 


yr. 


38 


5.45 


.94 


French tchrs. who 


taught 2 


yrs. 


21 


5.80 


.76 


Post-Instructional: 












German tchrs. who 


finished 


2 yrs. 


21 


5.43 


.73 


French tchrs. who 


finished 


2 yrs. 


21 


5.70 


.55 


German replicating 


: tchrs. 




12 


5.44 


.93 


French replicating 


; tchrs. 




14 


5-17 


1.05 



F-ratio = 1.681, not significant 
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THE ROLE OF SEX IN LANGUAGE LEARNING 



Throughout Project 5-0683, the sex variable repeatedly 
emerged as an important correlate of foreign language" learning. 
Special mention was taken of this significant role in the pri- 
mary statistical analyses; time after time females achieved 
significantly higher than males. 

This known significant contrast required that sex be 
utilized as a contrast in the Multivariate Analysis o** Vari- 
ance for objectives 1 and 2 and in the analysis of op .nion 
shifts. Appendix F. Sex occurred much less frequently as a 
significant factor in student achievement by the end of Level 
II (Table 50). 

A careful study of the many contrasts available also re- 
vealed that when sex was used as a dimension in connection 
with language laboratory types some significant differences 
existed: 

French II, Listening Discrimination : F>M at AA, p.<.020 
German II, Listening Discrimination : F> M at AR, p.<^.052 and 
German II, Final LB Listening : F^M at AR, p.<^ .001. 

These occurrences of significance by sex are the exception 
rather than the rule and may have been influenced by the small 
number of female observations in some audio-recording German 
classes. 

In all, those males who continued into a second year of 
foreign language study did as well as the females. This may 
indicate that only the more able students continue, i.e. most 
"dropouts” after Level I may be males. Th 3 was not investi- 
gated since Project data made no distinction between a student 
who was dropped because of missing data or change of school 
and those who freely elected not to continue because of low 
achievement. 



-106- 

ERjt 



TABLE 50 



UNIVARIATE ANALYSIS OF VARIANCE BY SEX (M vs F) 
AFTER TWO YEARS OF INSTRUCTION, ORIGINAL CLASSES 



FINAL TEST 



FRENCH 
(22 classes) 

F-ratio p.C 



GERMAN 
(26 classes) 

F-ratlo v.< 



1. Listening Discrim. 1.021 

2. MLA Coop. Listen .476 

3 . MLA Coop. Read 1*359 



.313 


1.^73 


.226 


.491 


5-677 


.018** M>F 


'A 

-a- 

CM 

• 


2.953 


.087 



AFTER ONE YEAR OF INSTRUCTION - REPLICATION CLASSES 



FRENCH 
(18 classes) 



GERMAN 
(10 classes) 



F-ratio p~< 



F-ratlo p.C 



1. Listening Discrim. 

2. MLA Coop. Listen 

3 . MLA Coop. Read 



9.929 .002** F>M 

1.082 .299 

2.168 .142 



.726 .395 

*317 *574 

4.654 .032* F>M 



SUMMARY OF RESULTS 



The findings of Project 7-0133 at the conclusion of the 
second year of foreign language study support the earlier 
report of Project 5-0683. In general "Traditional** students 
did better than "Functional Skills" classes in reading and as 
well as the more modern approaches in listening, speaking and 
writing. There again seemed to be no advantage for the classes 
which had access to the language laboratory twice weekly 
utilizing the commercially prepared programs. Teacher pro- 
ficiency examinations seem to have little relationship to 
most measures of class achievement. Student opinion was 
independent of teaching strategy and the influence of sex 
on student achievement declined in Level II, 



SECTION 17 j DISCUSSION 



Throughout the several years of the present research pro- 
ject, one goal was formost in the minds of the research staff: 
to evaluate new curriculum trends in a school situation ap- 
proaching the reality of secondary education in the United 
States. The research was never conceived as original but 
as the large scale replication of previous studies in a 
broader yet more relevant context. 

In the illumination shed by hindsight, several decisions 
made during the course of the research detracted somewhat from 
the potential contribution of the experiment. Among these, 
perhaps, were the choice not to include the "Traditional 
Modified" strategy suggested by John Carroll, the decision 
not to utilize the traditional Cooperative French/ German Tests 
during Level II and the replication, the lack of classroom 
tape recording "Functional Skills" classes in the replication 
and the non-validation of the much-used Opinion Scales . 

It should be remembered that, like much research, it was 
covertly assumed that the experiment would reveal advantages 
in fa Tr or of newer approaches to foreign language learning. 

The inception of the experiment itself was a reaction to 
the widely publicized work of Keating in which he found no 
advantage for the language laboratory. The present study 
avoids Keating’s errors but yields conclusions not markedly 
different from his. 

The decision, then, not to include the fourth, "Traditional 
Modified" strategy, because of logistic considerations was also 
tempered by the assumption that there would exist clearly signi- 
ficant differences on various language skills between "Traditional 
and "Functional Skills" classes. The same reasoning resulted in 
the discontinuation of the 1939-^1 Cooperative Tests as final 
achievement measures. 

When the replication was designed, results of the first 
year had not yet been analyzed. The replication, therefore, 
was more concerned with which type of laboratory was most ef- 
fective, not yet realizing that Troject S-O 683 would show that 
the laboratory per se had no effect on achievement. 

The Student Opinion Scal e , used throughout the experiment 
to show opinion differences between various groups of students, 
does not permit the overall evaluation of the student perception 
of foreign language study. It could have done this if the 
scale had been concurrently given to measure student opinion 
on other subject disciplines or on other phases of school life. 

The Opinion Scale was administered a number of times, always 
in alternating arrangements, and the repeated use of this 
measure may have influenced student responses. It can be 
assumed, however, that the introduction of bias in this manner 
was equal throughout the various strategies and laboratory 
systems. As it is, the Opinion Scale permits comparison only 
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within the experimental population and never permits a view 
of possible similar shifts in other areas of study. 

It is unfortunate that a larger sample of the replicating 
class was not administered Speaking and Writing Tests . A ten 
percent sample was attempted but due to testers* oversights 
Some students were omitted. This resulted in so few students 
that statistical contrasts could not be considered valid. It 
would have been better to have attempted a twenty-five percent 
sample considering the small number of classes involved. 

The research staff is aware of the tendency of the pro- 
fession to assume that teachers deviated from their assigned 
teaching strategies as a rationalization of the lack of signifi- 
cant findings in favor of newer strategies and materials. Every 
possible control was utilized that could be without unreason- 
ably distrubing the normal school routine. The reader should 
find the candid remarks of the teachers themselves on the Pro- 
ject of great interest. A transcription of the participating 
teachers* responses to the question, "Did the teachers stay 
within the assigned strategy when the observer was not in the 
class?” as well as on other facets of the research is re- 
produced in Appendix H. 

In retrospect, the experiment could have been improved 
in several ways. It was an improvement over previous in 
situ research in modern foreign languages in that adequate 
numbers of students representing two languages were involved 
in each treatment. Materials and tests were not, with the 
exception of the Valette Tests, especially written but were 
those most available and in widespread use. The statistical 
analyses were sophisticated and conservative. Data gathering 
was as extensive as could be permitted. Deporting has attempted 
to be factual and objective despite the fr.ct that the conclusions 
of the research are often in direct opposition to the profes- 
sional training, biases and judgements of the reporters. 
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SECTION V: CONCLUSIONS, IMPLICATIONS AND RECOMMENDATIONS 



The following conclusions can be drawn from the data 
analyses relevant to each of the stated objectives. This data 
represents thirty-five discrete measures on one thousand and 
ninety students in fifty-one French II and German II classes in 
secondary schools throughout Pennsylvania. Supporting data is 
furnished by data on six hundred and sixty-three students in 
twenty-eight replicating Level I classes. 



CONCLUSIONS 



Objective 1 : To determine which of three foreign language 

teaching strategies is most effective in achieving each 
of the four foreign language objectives: 

A. Listening: No significant differences existed 

among the three strategies after two years of in- 
struction. 

B. Speaking: No significant differences existed among 

the three strategies on the MLA Cooperative Classroom 
Speaking Test . Analysis of the unvalidated Valette 
Speech Production Test indicated some significance in 
the production of key foreign language sounds, FS> TLM. 

C. Reading: Significant differences existed in favor 

of the "Traditional" classes over the "Functional 
Skills Method" but not over "Functional Skills + 

Grammar" classes. 

D. Writing: On the MLA Cooperative Classroom Writing 

Test, which permits no writing by translation, no 
significant differences existed among the three teach- 
ing strategies. 

Objective 2 : To determine which of three language laboratory 

systems is best suited, economically and instructionally , 
to the development of pronunciation and structural accuracy. 

In Level I, Project 5-0683, no significant differences 
existed in foreign language skills classes using (l) a tape 
recorder in the classroom and those receiving additional 
practice twice weekly in either (2) an audio-active or (3) 
an audio-record language laboratory. At the end of Level II, 
significant differences between these three groups failed 
to emerge. Phe language laboratory had no discernable effect 
on listening or speaking but laboratory time may have in- 
fluenced reading skills. 

Objective 3 ? To determine which variable, or combination of 
variables, best predicts student achievement in foreign 
languages. 
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Disregarding minor variations among language skills 
and across languages, the best overall predictors of 
achievement in foreign languages were scholastic success 
as evidenced by preceding (l) English and ( 2 ) Social 
Studies grades and the Modern Language Aptitude Test . 
Multiple correlation coefficients ranged from .51 to 
089 for the various language skills, all highly Signifi- 
cant . 



Objective 4 ; To identify and compare student attitudes toward 
each of the teaching strategies and language laboratory 
systems . 

While student attitudes toward foreign language study 
continued to indicate downward shifts from commencement 
to final measurement, such shifts continued to be independent 
of both teaching strategy or language laboratory treatment. 

Personal interviews with two hundred and fifteen stu- 
dents also failed to reveal significant student attitude 
differences by experimental treatment. 

Objective 5 : To identify levels of foreign language mastery 

that are attainable in the secondary school language program. 

Student progress through functional skills text mate=- 
rial was at a slower rate than implied by the format of the 
texts. The student population, considered representative, 
did not achieve at the level expected under norms on stan- 
dardized tests published by the Educational Testing Service. 
Separate "Pennsylvania” norms were established. 

Objective 6 : To determine the strengths and weaknesses of 

selected commercial materials. 

The format of "Functional Skills" materials implied 
a greater rate of progress than most classes could do 
while devoting adequate time to the development of lan- 
guage as habit. Students in one functional skills text 
achieved significantly higher on criterion measures than 
students in the second functional skills text. 

Objective 7 : To identify teacher factors related to student 

achievement . 

There existed little relationship among teacher gradu- 
ate training, amount of teaching experience, and self-con- 
cepts of foreign language proficiency and class achievement 
after one, two, or four semesters of contact with the same 
teacher. No significant relationship existed between the 
scores of forty teachers on the MLA Proficiency Test for 
Teachers and Advanced Students and their classes' mean 
achievement after one, two or four semesters with the ex- 
ception of various measures of teach proficiency on class 
listening skills in French. 
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IMPLICATIONS 



1. Perhaps the greatest implication inherent in the con- 
clusions of Projects 5-0683 and 7-0133 is that the foreign 
language education profession has for the past decade or more 
been predicating teaching strategies, materials, and electro- 
mechanical devices on theoretical assumptions that may not be 
entirely valid. While the research conducted by the Project 
is admittedly imperfect, it hopefully represents the reality 
of the typical classroom. The implication for a re- exam i na tion 
of the theoretical bases for second language learning in the 
secondary school environment is evident in the research. 

The false implication that foreign language teaching 
reverts to the strict "traditional” classroom techniques of the 
1930's must not be read into the research. "Traditional" 
teachers as defined in the research had many more in sights in 
human growth, personal interrelations and the learning process 
than their predecessors of forty years ago. 

Countless improvements have been made in the physical 
classroom, text format and arrangement, and curriculum develop- 
ment. The generation of students utilized in this research has 
always known television, traveled more widely and seen the world 
grow smaller. Neither the teacher, the school, nor the students 
are the same from year to year. Retrogression is not possible 
and cannot be regarded as an implication of the research. The 
recasting of theory, perhaps once adequate, into current society 
is implied. 

2. The implication is clear that the "lock-step" language 
laboratory in the secondary school, no matter of what type, 
does not meet the expectations posited by earlier more closely 
controlled research. The twice-weekly utilization employed in 
the research may not be optimal but reflects the typical school 
situation. 

3. The implication is also clear that student recording 
equipment may be too ambitious an investment for student drill 
and pattern practice and that the classroom tape recorder 
offers the advantage of the "lock-step" language laboratory 

at a fraction of the cost. 

The lack of demonstratable relationship between scores 
on the MLA Teacher Proficiency Tests and student achievement 
implies that the most important phase of education is the pro- 
cess of teaching not the teacher's background in subject matter. 
This is given more strength when the lack of substantial skills 
differences among groups by teaching strategy, no matter how 
well defined, is considered. The research, in examining stu- 
dent attitude, superficial classroom methodology, and teacher 
proficiency may have failed to examine the real causes of 
variation in achievement. These may lie in the unexplored 
area of process--student motivation for second language learn- 
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ing and student-teacher interaction. The implication here is 
clear that more precise examinations need to be made of the 
role of motivation and classroom interaction and second lan- 
guage learning. 

5. Project classes in general did not compare favorably 
with the national norms published by the Educational Testing 
Service on the MLA Cooperative Classroom Tests . Since Project 
classes were widely representative and often more numerous than 
the "norming" population selected by ETS, one may infer either 
that the entire Project population was somehow "below average" 
or that the published norms may need revision. 

6. "Functional Skills + Grammar" classes were felt by 
the Project teachers themselves to be the probable "winner" 

on a poll taken at the end of the two year experimental phase. 
Such was not the case, rather the strategy in which grammar was 
presented first then practiced came out ahead on Project 5- 
0683 ?s "traditional" 1939-^1 Cooperative Tests . The "Modified 
Traditional" approach suggested by Carroll was not used. The 
implication is obvious for research on "grammar before" versus 
"grammar after" on a large enough scale to be sufficiently 
generalizeable . 
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RECOMMENDATIONS 



In the light of the conclusions that must be drawn from the 
data, researchers must make the following recommendations to the 
profession: 

1. There should be established a center concerned with the 
continuing long-term study of foreign language education in the 
’’real school” environment, especially concerning itself with 
the transfer, replication and dissemination of localized re- 
search and innovation to the broader context of the national 
curriculum; 

2. That the first task of this center be an Interpretive 
Study of Research and Innovation in Foreign Language Education 
written for the consumption of those most directly concerned 
with educational policy making and change, the school admini- 
strator, the school trustee, and the classroom teacher; 

3. That research be conducted to establish the optimum 
order of presentation of foreign language material, structure- 
drill versus drill-structure for varying age levels and grade 
arrangements, including the middle school; 

4. That research be directed toward assessing the role 
of student motivation in foreign language learning in the 
public school milieu; 

5. That future research involving teaching strategies or 
classroom procedures. »t4?mpt to precisely and objectively 
measure the instructional process within the individual class- 
room; 



6. That the tape recorder be considered essential equip- 
ment in every foreign language classroom; 

7. That future educational planning envision the language 
laboratory in terms of individualized practice in addition to 
regular classroom instruction rather than as a type of classroom 
activity; 

8. That secondary school language learning installations 
include student recording facilities for testing purposes rather 
than for use in drill activities; 

9. That experimental research design in foreign languages 
always include extensive pre-testing, including skills tests, 
to permit meaningful statistical evaluation; 



lOo That, in the absence of demonstratable relationships 
between teacher proficiency measures and student achievement, 
scores on the MLA Foreign Language Proficiency Tests for 
Teachers and Advanced Students be accepted by interested 
agencies as the equivalent of formal preparation in the 
foreign language but not as an additional criterion for 
teacher certification; 

11, That local norms be established for foreign language 
achievement tests and that published "national” norms and 
percentiles be publicly revised after widespread utilization 
of a specific test; 

12. That separate norms be reported on aptitude and 
achievement scales for males and females; 

13, That authors of "new" foreign language materials be 

more precise in their statements, explicit and implicit, of 
expected progress; 

14. That foreign language educators seriously re- 
examine the theoretical bases for formal second language 
learning in the secondary school environment. 

In conclusion, the old adage, "What works in theory does 
not work in practice" requires that the profession reconsider 
its theories in light of "real" practice rather than "idealized" 
situations. Only then can all students gain from the experi- 
ence of others. 
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APPENDIX A 



PARTICIPATING TEACHERS AND SCHOOLS 



PARTICIPATING TEACHERS, FRENCH 1967-68 



No. Teacher 


School 


School District 


111 Yauger, Virginia* 


German Township 


Albert Gallatin Area 


112 Yoder, John 


L. E. Dieruff 


Allentown City 


162 Edsall, Geraldine* 
342 ” 


Mt. Penn 


Ant ie tarn 


331 Bertoline, Veronica 


Bethel Park 


Bethel Park 


307 0* Leary, H. Ola* 


Nitschmann Jr. 


Bethlehem Area 


155 Maxwell, Evan 
337 


Boyertown 


Boyertown 


157 Searles, Milton 


S. Horace Scott 


Coatesville Area 


102 Cravens, Gertrude* 


Columbia Borough 


Columbia Borough 


172 Fetterman, Marguerite* 


Cumberland Valley 


Cumberland Valley 


310 Walker, Charles 


Darby Township 


Darby Township 


154 Kunz, Sandra* 
334 M 


Easton Junior High 


Easton Area 


347 Schneck, Dale 


Easton 


Easton Area 


122 Baker, Martha 


Hampton Township 


Hampton Township 


135 Esbenshade, Dorothy* 
335 


William Penn 


Harrisburg City 


158 Timmins, Marie* 


John Harris 


Harrisburg City 


152 Grant, Joanne* 


Haverford Township 


Haverford Township 


185 Formento, Stephen 


Mt. Lebanon 


Mt . Lebanon 


341 Kaczorowski, Daniel 


Mt. Lebanon 


Mt . Lebanon 


105 Mesko, Joan 


Nazareth 


Nazareth Area 


153 Kline, Eleanor 

333 


North Allegheny 


North Allegheny 


343 Louthan, Mary* 


North Hills 


North Hills 


171 Bedford, Dorothy 


Pen Argyl 


Pen Argyl 


346 Goldberg, Wendy* 


Sun Valley 


Penn Delco Union 


332 Nolan, Mary* 


Charles H. Boehm 


Pennsbury 


345 Treon, Barbara* 


Medill Bair 


Pennsbury 


121 Mainor, Lynnwood 


Central 


Philadelphia 


175 Waldbaum, Minerva* 


High School for GirlsPhiladelphia 


151 Clinchard, Joanna* 


Lincoln 


Philadelphia 


338 Stanford, Joyce 


Lincoln 


Philadelphia 


108 Matz, Roberta* 


Olney 


Philadelphia 


l64 Peregrim, Michael 
344 

101 Bruno, Robert 
301 " 


Central 


Scranton City 


South Park 


South Park 


l4l Melnick, Richard 


West Allegheny 


West Allegheny 


136 Fisher, Nancy* 

336 


Wilson Joint 


Wilson 



* denotes Mrs. 
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PARTICIPATING TEACHERS, GERMAN 1967-68 



No, Teacher School 



203 Kruger, David 
401 Smith, Mildred* 

224 Kern, Sara 

252 Doebel, Marilyn 

434 Reinbold, Ronald 
244 Jaeger, Ralph 
255 Voltz, Hedwig* 

435 

443 Hartzell, Robert 
264 Schmidley , William 
272 Schenck, Clark 
202 Hollinger, Arthur 

432 Gyenes, Judith* 

221 Chlodney, Rita* 

44 1 Brunner, William 
232 Loy, Erma 

206 Schmid, Maria* 

201 Schoedler, Ruth 
248 Oesterich, Edward 
283 Wollenhaupt, Wilbert 

204 McGonigle, Ruth* 

251 Clark, Polly 
431 

282 Orling, Beth 

442 Elliott, Judson 

433 Reeves, William 

214 Shuster, Mally* 

213 Santner, Joseph 
246 Koshatka, Sophie* 

266 Wunner, Louise* 

444 

211 Hardenstine, Ruth* 

215 Yenis, Anthony 
243 Reesar, Robert 

222 Singer. Robert 

205 Schlicher, Frederick 



Annville-Cleona 
Annville-Cleona 
Baldwin 
Bethel Park 
Bethel Park 
Blue Mountain 
Central Bucks 

Plymouth - Wh i t emar sh 

Plymouth-Whitemarsh 

Cumberland Valley 

Donegal 

Smmaus 

Hampton Township 

William Pen n 

John Harris 

Hatboro-Horsham 

Kutztown 

Mt, Lebanon 

Muhlenburg 

Nazareth 

Palisades 

Pen Argyl 

Sun Valley 

Med ill Bair 

Central 

G, Washington 

High School for Girls 

Olney 

Pine Grove 
Oliver 

Schuylkill Valley 
West Scranton 
Upper Perkiomen 
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School District 

Annville-Cleona 
Annville-Cleona 
Baldwin-Whitehall 
Bethel Park 
Bethel Park 
Blue Mountain 
Central Bucks 

Colonial 

Colonial 

Cumberland Valley 
Donegal 

East Penn Union 
Hampton Township 
Harrisburg City 
Harrisburg City 
Hatboro-Horsham 
Kutztown Area 
Mt , Lebanon 
Muhlenburg Township 
Nazareth Area 
Palisades 

Pen Argyl Area 
Penn Delco Union 
Pennsbury 
Philadelphia City 
Philadelphia City 
Philadelphia City 
Philadelphia City 

Pine Grove Area 
Pittsburgh City 
Schuylkill Valley 
Scranton City 
Upper Perkiomen 



* denotes Mrs 



APPENDIX B 



TEACHING STRATEGIES, GENERAL CRITERIA AND 
EXPECTED LEVELS OF PROFICIENCY 



List of general criteria - Functional Skills Method 

A. Use of target language in classroom 

1. By the student: for all responses 

2. By the teacher: for daily routine communication 

B. Native tongue to be used only for describing grammar 
and syntax 

C. Sequence of learning 

1 . Hearing 

2. Speaking 

3. Reading 
4 0 Writing 

D. Grammar 

1. Descriptive rather than prescriptive 

2. Incidental to functional skills being taught 

E. Reading 

1. Printed material always presented as a trans- 
scription of spoken forms 

2. As direct communication without the intermedi- 
ary of translation from the target language to 
the native tongue 

F. Writing - learned first as a transcription of spoken 
forms 

G. Testing - written and oral tests given in order to 
test for listening comprehension and speaking pro- 
ficiency as well as reading and writing skills 

H. Culture - "total culture" as reflected in language 
behavior is taught as opposed to refinement or 
prestige culture 



Expected level of proficiency in four skills - Functional 
Skills Method 

A. Listening comprehension 

1. At end of semester 

a. Phonemic discrimination - all basic sounds 
of the language 

b. Understanding of basic words and phrases 

2. At end of year 

a, Phonemic discrimination - nearly all 
phonemic differences 

b. Understand simple conversation spoken at 
normal speed 
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B. Speaking 

1. At end of semester 

a. Repeat any word or phrase with good accent 
and intonation 

b. Ability to respond to simple questions and 
to vary form and structure in simple direc- 
ted conversation 

2. At end of year 

a. Repeat sentences with correct accent and 
intonation 

b. Engage in simple conversation on a variety 
of basic everyday situations 

c. Ability to vary spontaneously any basic 
structures already learned 

C. Reading 

1. At end of semester 

a. Reproduce in writing simple phrases pre- 
viously learned 

b. Reproduce from dictation basic dialogs 
already learned 

2. At end of year 

a. Ability to answer questions in written 
form with spontaneous variation of forms 
and structures previously learned 

b. Ability to express in writing simple con- 
cepts dealing with everyday situations 

List of general criteria - traditional method 

A. Use of native tongue in the classroom predominant. 

Target language not to be used for purposes of communica- 
ting instructions or information to students. 

B. Translation 

1. Directly from native tongue to target language 

2. Reading by translation from target language to 
native tongue 

C. Vocabulary 

1. Word for word equivalents 

2. Academic and literal^' lexicon stressed 

D. Grammar 

1. Analysis before application 

2. Language organized into word lists, paradigms, 
principal parts, rules 

3. Analysis in depth of grammatical structures 
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E. Testing 

1. Grades based on written tests 

2. Use of vocabulary and idiom quiz 

3. Frequent use of dictation test 

4. Use of tests requiring thorough knowledge of 
paradigms or lists 

F. Culture - the following cultural areas are emphasized: 

1. Great historical and literary personalities 

2. Monuments 

3. Masterpieces of art, music and literature 

G. General orientation of traditional program is 
academic and intellectual » 



Expected level of proficiency in four skills - Traditional 
Strategy 

A. Listening comprehension 

1. At end of semester 

a. Understand simple words and phrases care- 
fully and slowly enunciated 

b. Distinguish gross phonemic variations 

2. At end of year 

a. Understand simple directions and basic 
conversational phrases spoken at slower 
than normal speed 

b. Distinguish most phonemic differences 

B. Speaking 

1. At end of semester 

a. Ability to repeat sounds, words and phrases 
previously learned 

b. Respond with little hesitation to simple 
questions using previously memorized answers 

2. At end of year 

a. Ability to repeat after the model all 
sounds, words and phrases 

b. Ability to vary basic structural patterns 
in responding to simple questions 

C. Reading 

1. At end of semester 

a. Read and understand simple prose with 
known vocabulary 

b. Recognize and identify grammatical struc- 
tures contained in this prose 

2. At end of year 

a. Read and understand short narratives 

b. Recognize grammatical structures 

c. Sight reading of simple prose passages 

B-3 



D. Writing 

1. At end of semester 

a. Write correctly basic conversational phrases 

b. Ability to take dictation of familiar naterial 

2. At end of year 

a. Ability to compose short prose passage 
showing correct usage of grammar 

b. Ability to take dictation of some un- 
familiar material with known vocabulary 



List of general criteria : Functional Skills-Grammar Method 

A. Use of target language in classroom 

1. By the student: for all responses 

2. By the teacher: for daily routine communication 
to pupils of instructions, cues and models 

B. Native tongue to be used only for describing grammar 
and syntax 

C. Sequence of learning 

1. Hearing 

2. Speaking 

3. Reading 

4. Writing 

D. Grammar 

1. Descriptive rather than prescriptive 

2. Incidental to functional skills being taught 

E. Reading 

1. Printed material always presented as a tran- 
scription of spoken forms 

2. As direct communication without the intermediary 
of translation from the target language to the 
native tongue 

F. Writing - learned first as a transcription of spoken 
forms. 

G. Testing - written and oral tests given in order to 

test for listening comprehension and speaking proficiency 
as well as reading and writing skills 

H. Culture - "total culture" as reflected in language 
behavior is taught as opposed to refinement or prestige 
culture 



Expected level of proficiency in four skills - functional 
skills-grammar method 

A. Listening comprehension 
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. At end of semester 

a. Phonemic discrimination - all basic sounds 
of the language 

b. Understanding of basic words and phrases - 
spoken at normal speed 

2. At end of year 

a. Phonemic discrimination - nearly all 
phonemic differences 

b. Understand simple conversation spoken at 
normal speed 

B. Speaking 

1. At end of semester 

a. Repeat any word or phrase with good accent 
and intonation 

b. Ability to respond to simple questions and 

to vary form and structure in simple directed 
conversation 

2. At end of year 

a. Repeat sentences with correct accent and 
intonation 

b. Engage in simple conversation on a variety 
of basic everyday situations 

c. Ability to vary spontaneously any basic 
structures al:?eady learned 

C. Reading 

1. At end of semester 

a. Read and understand directly (without 
translating) simple dialogs 

b. Understand grammatical functions in the 
reading material 

2. At end of year 

a. Read and understand directly dialogs and 
simple prose narratives dealing with every- 
day situations. 

b. Ability to understand all grammatical 
functions in the readings 

D. Writing 

1. At end of semester 

a. Write simple phrases previously learned with 
understanding of the grammatical functions 
involved 

b. Reproduce from dictation basic dialogs already 
learned 

2. At end of year 

a. Ability to answer questions in writing with 
spontaneous variation of forms and structures 
previously learned 

b. Ability to express in writing simnle concepts 
dealing with everyday situations 
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APPENDIX C 



OBSERVATION REPORT FORM 



OBSERVATION REPORT 



Second Model - January, 1966 

Observation Report--Field Consultant Date_ 

Teacher School Cond . 



FSM 

1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 

10 . 

11 . 

12 . 



Teacher speaks foreign language 

Students speak foreign language 

Grammar: Subsidiary to functional skills 

Speaking only what was listened to 

Reading as direct communication 

Reading only what was listened to and spoken 

Writing only what was listened to, spoken and read 

Language as a cultural behavior pattern 

Testing as demonstration of functional proficiency 

Average use of tapes- -ten minutes per day 

Average pronunciation drill — 3-5 minutes per day 

Vocabulary taught in context only 




FSG 



1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 

10 . 

11 . 

12 . 



Teacher speaks foreign language 

Students speak foreign language 

Grammar: Descriptive; use before rules 

Speaking only what was listened to 

Reading as direct communication 

Reading only what was listened to and spoken 

Writing only what was listened to, spoken and read 

Language as a cultural behavior pattern 

Testing as demonstration of functional proficiency 

Average use of tapes — ten minutes per day 

Average pronunciation drill — 3-5 minutes per day 

Vocabulary taught in context only 





1 . 




2. 




3. 




4. 




5. 




6. 




7. 




8. 




9 - 




10. 




11. 


1 


12. 



TLM 



1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 

10 . 



1. Vocabulary drill 

2. Translation of reading lesson 

3. Grammar — formal analysis 

4. Pronunciation — teacher 

5. Pronunciation — student 

6. Reading for total comprehension 
7* Writing — free composition 

8. Culture (refinement) 

9. Use of tape recorder 

10. Use of visual aids 
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APPENDIX D 



COMPARISON OF ORIGINAL AND REPLICATING STUDENTS 



TABLE 51 



COMPARISONS OF POPULATIONS BY INTELLIGENCE 



Pre-Experimental California Test of Mental Maturity (short form) 



Non-Language IQ 








N 


Mean 


S.D. 


P- <■ 


1. Original French Students 1210 

2. Original German Students 945 


111.09 

112.63 


12. 34 
12.12 


n. s. 


3. Replicating French Students 397 

4. Replicating German Students 242 


113.16 

112.58 


11.09 

11.83 


n. s. 



Source 


df 


Sm.Sq . 


Mean Sq. 


F 


Between 


3 


1995 


665.00 


4 . 58 * 


Within 


2790 


405341 


145.28 





SIGNIFICANCE OF DIFFERENCES BETWEEN MEANS 





Tukey 


"A" Multiple 


Range Test 




Group : 


1 


4 


2 


3 


Mean: 

1 111.09 

4 112.58 

2 112.63 

3 113.16 


111.09 


112.58 

1.49 


112.63 

1.54 

.05 


113.16 

2.07 

.58 

.53 














* p.^.05, 


** P< 


.01. 
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TABLE 52 



COMPARISONS OF POPULATIONS BY INTELLIGENCE 



Pre-Experimental California Test 


of Mental Maturity (short 


form) 


Total IQ 


N 


Mean 


S.D. 


P- ^ 


1. Original French Students 

2. Original German Students 


1209 

945 


113.46 

115.22 


11.04 

10.29 


.05 


3. Replicating French Students 

4. Replicating German Students 


397 

242 


115.89 

113.64 


10.27 

11.30 


.01 


Source df Sm.Sq. 




Mean Sq. 


F 




Between 3 2723.00 

Within 2789 319697.00 




907 . 67 
114.63 


7 . 92 ** 



SIGNIFICANCE OF DIFFERENCES BETWEEN MEANS 



Group : 



Tukey "A" Multiple Range Test 
14 2 3 



Mean: 113.46 113.64 115.22 115.89 

1 113.46 .18 1.76* 2.43** 

4 113.64 I.58* 2.25** 

2 115.22 .6? 

3 115.89 



* p.< .05, ** p. ^ .01. 
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APPENDIX E 



STUDENT ACHIEVEMENT BY GRADE 




TABLE 53 



ACHIEVEMENT BY GRADE, 





FINAL 


LISTENING TEST 


- FRENCH 






Grade 


N 


Mean 


sjL. 


1. 


9 th 


44 


15.73 


7.19 


2. 


10th 


249 


21.02 


7.21 


3 . 


12th 


106 


22.25 


7.93 


4 . 


11th 


97 


23.52 


7.36 


Source 


df 


Sum. Sqs. 


Mean Sq . 


F 


Between 


3 


1958.66 


652.89 


10.75 


Within 


492 


29875.98 


60.72 





Significance of Differences Between Ordered Means, 
Tukey "A" Multiple Range Test 





10 th 


12 th 


11th 


9th 


5 . 29 ** 


6.53** 


7 . 79 ** 


10th 




1.23 


2.50** 


12th 






1.26 


** p.^ .01. 
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TABLE 54 



ACHIEVEMENT BY GRADE, 





FINAL 


READING TEST - 


FRENCH 






Grade 


N 


Mean 


S.D. 


1 . 


9th 


44 


16.64 


6.57 


2. 


10th 


249 


20.97 


7.47 


3. 


12th 


106 


21.92 


10.02 


4. 


11th 


97 


24 . 66 


10.13 


Source 


df 


Sum.Sqs. 


Mean Sq . 




Between 


3 


2098.04 


699.35 




Within 


492 


36065.93 


73.31 





Significance of Differences Between Ordered Means, 
Tukey "A” Multiple Range Test 



9 th 
10th 



10th 


12th 


11th 


4.33** 


5.28** 


8.02** 




.95 


3.69** 






2.74** 



12 th 



TABLE 55 



ACHIEVEMENT BY GRADE, 
FINAL LISTENING TEST - GERMAN 





Grade 


N 


Mean 


S.D. 




9th 


45 


17.78 


9.73 




10th 


292 


18.86 


7.68 




11th 


104 


19.10 


8.17 




12th 


123 


22.20 


9.08 


Source 


df 


Sum. Sqs. 


Mean Sq . 


F 


Between 


3 


1163.88 


387.96 


5.68 


Within 


560 


38248.10 


68.30 





Significance of Differences Between Ordered Means, 
Tukey "A” Multiple Range Test 





10th 


11th 


12th 


9 th 


1.08 


1.32 


4.42** 


10th 




.24 


3.34** 


11th 






3.10** 



** p. ^ .01. 
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TABLE 56 



ACHIEVEMENT BY GRADE, 





FINAL 


READING TEST - 


GERMAN 






Grade 


N 


Mean 


S.D. 


1 . 


9th 


45 


15.36 


7.16 


2. 


11th 


104 


17.52 


7.95 


3. 


10th 


292 


18.05 


7.58 


4. 


12th 


123 


20.72 


9.48 


Source 


df 


Sum.Sqs. 


Mean Sq . 


F 


Between 


3 


1189.55 


396.52 


6.09 


Wi thin 


560 


361*64.64 


65.12 





Significance of Differences Between Ordered Means, 
Tukey "A" Multiple Range Test 





11 th 


10 th 


12 th 


9 th 


2 . 16 ** 


2 . 69 ** 


5.46** 


11th 




.53 


3.19** 


10th 






2.67** 


** p.^.oi. 









TABLE 57 



COMPARISON OF ACHIEVEMENT BY GRADE, 
FINAL LISTENING TEST - FRENCH REPLICATORS 





Grade 


N 


Mean 


S.D. 




1 . 


8th 


62 


13.94 


6.09 




2. 


9 th 


145 


15.03 


5.35 




3. 


10th 


152 


15.01 


5.44 




4. 


11th 


54 


15.01 


3.85 






Source 


df 


Sum.Sqs. 


Mean Sq. 


F-ratio 




Between 


3 


61.24 


20.41 


.72 




Within 


389 


11049.61 


28.41 




No 


significant differences 


existed among 


the several 


grades. 



TABLE 58 



COMPARISON OF ACHIEVEMENT BY GRADE, 
FINAL READING TEST - FRENCH REPLICATORS 





Grade 




N 


Mean 




S.D. 




1. 


8th 




62 


14.68 




4.87 




2. 


9th 




145 


16.03 




5.66 




3. 


10 th 




132 


15.79 




't.33 




4. 


11th 




54 


17.33 




4.86 






Source 


df 


Sum. So s. 


Mean Sq 


• 


F-ratio 




Between 


3 


207.31 




69.11 




2.75** 




Within 


309 


9780.92 




25.14 







Significance of Differences Between Ordered Means, 
Tukey "A" Multiple Range Test 





10th 


9th 


11th 


8th 


1.12* 


1.35** 


2 . 66 ** 


10th 




.23 


1 . 54** 


9th 






1.31** 



* P.<.05, ** p.< .01. 
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TABLE 59 



COMPARISON OF ACHIEVEMENT BY GRADE, 
FINAL LISTENING TEST - GERMAN REPLICATORS 





Grade 




N 


Mean 


S.D. 


1 . 


8th 




24 


10.88 


3.42 


2. 


9th 




111 


14.11 


5.82 


3. 


10th 




66 


16.97 


5.70 


4. 


11th 




38 


14.08 


5-63 




Source 


df 


Sum.Sas. 


Mean Sq. 


P-ratio 




Between 


3 


740. 58 


246.86 


7 . 97** 




Within 


235 


7282.03 


30.99 





Significance of Differences Between Ordered Means, 
Tukey r A w Multiple Range Test 





11th 


9th 


10th 


11th 


3.20** 


3.23** 


6 . 09 ** 


9th 




.03 


2 . 89 ** 


10th 






2 . 86** 


** p.< .01. 









E-7 




t 



TABLE 60 

COMPARISON OF ACHIEVEMENT BY GRADE, 
FINAL READING TEST - GERMAN REPLICATORS 





Grade 




N 


Mean 


S.D. 




1 . 


8th 




24 


12.08 


4.42 




2. 


9th 




111 


13.78 


4.43 




3. 


10th 




66 


15.11 


3.98 




4. 


11th 




38 


13.82 


4.38 






Source 


df 


Sum.Sqs. 


Mean Sa. 


F-ratio 




Between 


3 




175.32 


58.44 


3 . 16 ** 




Within 


235 




4344.61 


18.49 





Significance of Differences Between Ordered Means, 
Tukey "A" Multiple Range Test 





9th 


12th 


11th 


8th 


1.70** 


1.73** 


3.02** 


9th 




.03 


1 . 32 * 


12 th 






1.29* 


* p. /.05, 


** p.<£ .01. 
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APPENDIX F 



STUDENT OPINION CHANGES BY SEX 



o 

ERIC 



last 



first middle 



Name 



Date 



Instructor School 

STUDENT OPINION SCALE 

This scale is an attempt to get your general impression about the study 

of foreign language. There is no right or wrong feeling or impression. 

Your responses on this scale will not be used by the teacher to determine 
your grades. 

You will see that on each line there are two words, such as: 

12 3 4 5 6 7 

intelligent ( ) ( ) ( ) ( ) ( ) ( ) ( ) stupid 

Between these two words are seven spaces, and somewhere between the 
two words (or extremes) is your impression about something. If you are 
asked your impression about television news programs, you might check as 
follows: 





1 


2 




3 't 


5 


6 


7 




intelligent ( ) 


(X) 


( 


) ( ) 


( ) 


( ) 


( ) 


stupid 


but if you were asked your 


impression about 


high school, 


you might check 


somewhere else. In 


some cases 


you may 


not have a 


feeling 


one way or the 


other, in which case 


you would 


place an "X" 


in the 


middle 


space (no. 4 ). 


For each 


pair of 


words 1 


on this scale, place an 


"X" in 


the position be 


tween 1 and 


7 that best fits your impression about 
THE STUDY OF FRENCH (OR GERMAN) THIS 

1 2 3 4 5 6 


• • • 

YEAR 

7 


• 


dull 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


exciting 


lifeless 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


alive 


boring 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


interesting 


enjoy 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


dread 


like 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


dislike 


least 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


most 


necessary 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


unnecessary 


hard 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


easy 


meaningless 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


meaningful 


important 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


unimportant 


unsuccessful 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


successful 


discouraging 


( ) 


( ) 


( ; 


( ) 


( ) 


( ) 


( ) 


rewarding 


worthless 


( ) 


( ) 


( / 


( ) 


( ) 


( ) 


( ) 


valuable 


fair 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


unfair 


practical 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


impractical 


inexact 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


exact 


certain 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


( ) 


uncertain 


disorganized 


( ) 


( ) 


( ) 


( ) 
F-l 


( ) 


( ) 


( ) 


organized 



i 

i 



TABLE 6l 







STUDENT OPINION CHANGES 












BY SEX: FRENCH 












7 Point Scale: l=low, 7=high 










Group 




N Mean 


S.D. 


E 






1. Males, 


Pre-Exp. 


133 5.19 


.72 




01 




2. Females 


, Pre-Exp. 


239 5.56 


.65 


• 




3. Males, 


End 1st yr. 


133 4.85 


1.03 




01 




4. Females 


, End 1st yr. 


239 5.39 


.90 


• 




5. Males, 


Fall 2nd yr. 


127 4.82 


.99 




01 




6. Females 


, Fall 2nd yr. 


295 5.33 


.85 


• 




7. Males, 


Mid 2nd yr. 


127 4.50 


.91 




01 




8. Females 


, Mid 2nd yr. 


245 5.06 


.93 


• 




9. Males, 


End 2nd yr. 


127 4.34 


1.08 




01 




10. Females 


, End 2nd yr. 


245 5.05 


.97 


• 




Source 


df 


Sm.Sq. Mean Sq. 




F 




Between 


9 


220.75 


24.53 




30.23** 




Within 


1850 


1501.03 


.81 






SIGNIFICANCE OF DIFFERENCES BETWEEN 


MEANS 










Tukey "A" Multiple Range Test 








Group: 9 


7 5 3 


10 8 


1 


6 


4 2 


Mean: 4.3*+ 4 


.50 4.82 4.85 


5.05 5.06 


5.19 


5.33 


5.39 5.56 


9 


4.34 


.16 .48** .51 


** .71** .72** 


.85** 


.99** 


1 . 05 ** 1.22** 


7 


4.50 


. 32 ** .35 


** . 55** . 56** 


. 69 ** 


. 83 ** 


.89** 1 . 06 ** 


5 


4.82 


.03 


. 23** . 24 


.37** 


.51** 


.57** .74** 


3 


it . 85 




.20 .21 


.34** 


.48** 


.54** .71** 


10 


5-05 





.01 


.14 


.28* 


.34** .51** 


8 


5.06 








.13 


.27* 


.33** . 50 ** 


1 


5.19 








— 


.14 


.20 .37** 



6 

4 

2 



5.33 

5.31 

5.56 



.06 



. 23 * 

.17 



p. < . 05 , 



** 



p. ^ . 01 
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TABLE 62 



STUDENT OPINION CHANGES 
BY SEX: GERMAN 

7 Point Scale: l=low, 7=high 

Group N Mean S.D. 



1. Males, Pre-Exp. 

2. Females, Pre-Exp. 

3. Males, End 1st yr. 

4. Females, End 1st yr 

5. Males, Fall 2nd yr. 

6. Females, Fall 2nd yr. 

7. Males, Mid 2nd yr. 

8. Females, Mid 2nd yr. 

9. Males, End 2nd yr. 

10. Females, End 2nd yr. 

Source df 

Between 9 

Within 2270 



277 


5.38 


.69 


179 


5.52 


.60 


277 


5.33 


.87 


179 


5.28 


.97 


279 


5.1^ 


.92 


179 


5.27 


.87 


277 


4.93 


1.05 


179 


5.04 


.98 


277 


4.87 


1.05 


179 


5.04 


1.04 


Sm • Sq . 




Mean Sq. 


92.83 




10.31 


1918.87 




• 85 




n. s. 



n. s. 
n. s. 



n. s. 



n. s. 

_F 

12 . 20 ** 



SIGNIFICANCE OF DIFFERENCES BETWEEN MEANS 
Tukey "A” Multiple Range Test 



Group; 


9 7 


8 


10 


5 


6 


4 


3 


1 


2 


Mean; 


4.87 4.93 


5.04 


5.04 


5. 1** 


5.27 


5.28 


5.33 


5.38 


5.52 


9 


4.87 


.06 


.17 


.17 


.27* 


.40** 


.41** 


.46** 


.51** 


.65** 


7 


4.93 




.11 


.11 


.21 


.34** 


.35** 


.40** 


.45** 


.59** 


8 


5.04 





— 


.00 


.10 


.23* 


.24 


.29* 


.34** 


.48** 


10 


5.04 





— 


— 


.10 


.23* 


.24* 


.29** 


.34** 


.48** 


5 


5.14 





— 


— 


— 


.13 


.14 


.19 


.24 


.38** 


6 


5.27 





— 


— 


— 


— 


.01 


.06 


.11 


.25* 


4 


5.28 








— 


— 


— 


— 


.05 


.10 


.24* 


3 


5.33 





— 


— 


— 


— 


— 


— 


.05 


.19 


1 


5.38 





— 


— 


— 


— 


— 




— — — — 


.14 



2 5.52 

* p.^. 05 , ** p.^. 01 . 

F-3 
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TABLE 63 

STUDENT OPINION SCALE - FRENCH, MALES 
Two-Year Period 



7 Point Scale: l=low, 7=high 








Groups: 




N 


Mean 


S.D. 


1. Pre-experimental, 


Traditional 


17 


5.21 


.61 


2 . Pre-experimental, 


Functional Skills-grammar 


69 


5.06 


.69 


3. Pre-experimental, 


Functional Skills Method 


47 


5.38 


• 

->o 

00 


4. Mid-experimental, 


Traditional 


17 


77 


1.25 


5. Mid-experimental, 


Functional Skills-grammar 


69 


4.67 


1.07 


6. Mid-experimental, 


Functional Skills Method 


47 


5.15 


.79 


7. Post-experimental 


, Traditional 


17 


4.20 


1.05 


8. Post-experimental 


, Functional Skills-grammar 


66 


4.35 


1.18 


9. Post-experimental 


, Functional Skills Method 


44 


4.39 


.95 


Source df 


Sm . Sq s . Mean Sq . 




F 




Between 8 


57.06 7.13 




7.95 




Within 384 


344. 75 .90 









SIGNIFICANCE OF DIFFERENCES BETWEEN ORDERED MEANS 



Tukey "A" Multiple Range Test 



Group: 


7 


8 9 


5 


4 


2 


6 


1 


3 


Mean: 


4.20 


4.35 4.39 


4.67 


4.77 


5.06 


5.15 


5.21 


5.38 


7 4.20 


— 


•15 .19 


.47 


• 51 


.86** 


.95** 


1.01** 


1.18** 


8 4.35 


— 


.04 


.32 


.42 


.71* 


. 80 * 


.86** 


1 . 03 ** 


9 4.39 


— 





.28 


.38 


.67* 


.76* 


.82** 


. 99 ** 


5 4.67 


— 





— 


.10 


.39 


.48 


.5 4 


• 71 * 


4 4.7? 










.29 


.38 


.44 


.61 


2 5.06 












.09 


.15 


.32 


6 5.15 


— 





— 


— 


— 


— 


.06 


.18 


1 5.21 
3 5.38 

* P-< • 


05, ** 


p. ^ .01. 












.17 



F-4 



i 



TABLE 64 

ANALYSIS OF VARIANCE 
STUDENT OPINION SCALE - FRENCH, FEMALES 

Two-Year Period 
7 Point Scale: l=low, 7=high 



N Mean S.D. 

24 5.62 .66 

163 5.53 .69 

52 5.64 .56 

24 5.14 .71 

163 5.31 .97 

52 5.73 .63 

24 4.90 .87 

166 5.07 1.01 

55 5.06 .91 

F 



Between 8 41.87 5.23 7.21 

Within 714 518.47 .73 

SIGNIFICANCE OF DIFFERENCES BETWEEN ORDERED MEANS 





Tukey "A" 


Multiple Range Test 








Group : 7 


9 


8 


4 


5 


2 


1 


3 


6 


Mean: 4.90 


5.06 


5.07 


5.14 


5.31 


5.53 


5.62 


5.64 


5.73 


7 4.90 — 


.16 


.17 


.24 


.41 


.63** 


.72** 


.74** 


. 83 ** 


9 5.06 — 


— 


.01 


.08 


.25 


.47 


.56* 


. 

Vjx 

00 

* 


. 67 ** 


8 5.0? 


— 


— 


.07 


.24 


.44 


.55* 


. 57 * 


.66** 


4 5.14 — 


— 


— 


— 


.17 


.39 


.48* 


. 50 * 


.59* 


5 5.31 — 










.22 


.31 


.33 


.42 


2 5.53 — 












.09 


.11 


.20 


1 5.62 — 


— 


— 


— 


— 


— 


— 


.02 


.11 


3 5.6it — 

6 5.73 




“ “ “ “ 


— — — — 


— — — — 


— — — — 


— — — — 


— — 


.09 



* p.< . 05 , ** p.< . 01 . 

F-5 



Groups: 

1 . Pre-experimental, Traditional 

2. Pre-experimental, Functional Ski 11s -grammar 
3* Pre-experimental, Functional Skills Method 

4. Mid-experimental, Traditional 
5* Mid-experimental, Functional Ski 11s -grammar 

6. Mid-experimental, Functional Skills Method 

7. Post-experimental, Traditional 

8. Post-experimental, Functional Skills-grammar 

9. Post-experimental, Functional Skills Method 

Source df Sm. Sqs. Mean Sa. 




TABLE 65 

STUDENT OPINION SCALE - GERMAN MALES 



Two-Year Period 
7 Point Scale: l=low, 7=high 



Groups : 




N 


Mean 


S.D. 


1. Pre-experimental, 


Traditional 


72 


5.23 


.72 


2. Pre-experimental, 


Functional Ski 11s -grammar 


89 


5.58 


.69 


3. Pre-experimental, 


Functional Skills Method 


116 


5.32 


.65 


4. Mid-experimental, 


Traditional 


72 


5.12 


<M 

CO 

• 


5. Mid-experimental, 


Functional Skills-grammar 


89 


5.53 


• 

00 


6. Mid-experimental, 


Functional Skills Method 


116 


5.30 


.94 


7. Post-experimental 


, Traditional 


78 


4.84 


.92 


8. Post-experimental 


, Functional Skills-grammar 


90 


5.02 


.94 


9. Post-experimental 


, Functional Skills Method 


116 


4.77 


1.19 


ANALYSIS OF VARIANCE 








Source df 


Sm. Sqs. Mean Sq. 




F 




Between 8 


59.46 7.43 




9.68 




Within 824 


633.10 .77 









SIGNIFICANCE OF DIFFERENCES BETWEEN ORDERED MEANS 
Tukey "A" Multiple Range Test 



Group: 9 


7 


8 


4 


1 


6 


3 


5 


2 


Mean: 4.77 


4.84 


5.02 


5.12 


5.23 


5.30 


5.32 


5.53 


5.58 


9 4.77 — 


.07 


.25 


• 35* 


.46** 


.53** 


.55** 


.76** 


. 81 ** 


7 it. 84 — 


— 


.18 


.28 


.39* 


.46** 


.48** 


. 69 ** 


.84** 


8 5.02 — 


— 


— 


.10 


.21 


.29 


.30 


.15** 


.56** 


4 5.12 — 


— 


— 


— 


.11 


.18 


.20 


.41* 


.46** 


l 5.23 — 










.07 


.09 


.30 


• 35 


6 5.30 — 

1 si? 


— 


— 


— 


— 


— 


.02 


.23 

.21 


.28 
# ?6 


5 5.53 — 


. . . . 


. . w . 


M . 


. — . 


. . . . 


.... 




.05 



2 5.58 

* p. <. 05 , ** p.< . 01 . 



F-6 



TABLE 66 



STUDENT OPINION SCALE - GERMAN FEMALES 
Two-Year Period 
7 Point Scale: l=low, 7=higL 

Groups : 

1. Pre-experimental, Traditional 

2. Pre-experimental, Functional Skills-grammar 

3. Pre-experimental, Functional Skills Method 

4. Mid-experimental, Traditional 

5. Mid-experimental, Functional Skills-grammar 

6. Mid-experimental, Functional Skills Method 

7. Post-experimental, Traditional 

8. Post-experimental, Functional Skills-grammar 

9. Post-experimental, Functional Skills Method 



N 


Mean 


S.D. 


33 


5.61 


.60 


56 


5.46 


. 6l 


90 


5.53 


. 60 


33 


5.31 


• 95 


56 


5.34 


1.01 


90 


5.24 


.96 


32 


5.47 


. 86 


55 


5.30 


.77 


90 


4.74 


1.16 







APPENDIX G 



PROJECT NORMS 

MLA COOPERATIVE CLASSROOM TESTS 



PROJECT NORMS, MLA 


COOPERATIVE 


CLASSROOM 


READING TEST 






FRENCH, FORM LB, 


1 SEMESTER 








Traditional 


Functional 


Skills 


Total Population 


N =210 


N=1029 




N 


=1239 


Raw Score 


Percentile 


Raw Score 


Percentile 


Raw Score 


Percentile 


22-28 


99 


26-42 


99 


26-42 




99 


21 


96 


23-25 


98-99 


23-25 




98-99 


20 


94 


22 


98 


22 




98 


19 


91-92 


21 


97-98 


21 




97 


18 


87 


20 


96 


20 




95-96 


17 


79 


19 


93-94 


19 




93 


16 


70 


18 


89-90 


18 




89 


15 


6 l 


17 


85-86 


17 




84-85 


14 


49 


16 


80 


16 




78 


13 


35 


15 


70-71 


15 




69 


12 


24 


14 


59 


14 




58 


11 


14 


13 


48-49 


13 




46 


10 


7-8 


12 


37-38 


12 




35 


9 


3 


11 


27 


11 




25 


0-8 


1 


10 


17 


10 




15-16 






9 


10 


9 




9 






8 


5 


8 




4-5 






7 


2-3 


0-7 




2 






0-6 


1 








Range 7- 


28 


Range 03- 


■42 


Range 


03 


-42 


Median 


14 


Median 


13 


Median 




13 


Mode 


14 


Mode 


14 


Mode 




14 


Mean 


14.938 


Mean 


12.15 


Mean 




13.8 


S.D. 


3-301 


S.D. 


3.844 


S.D. 




3.781 



PROJECT NORMS, MLA COOPERATIVE CLASSROOM LISTENING TEST 

FRENCH, FORM LB, 1 SEMESTER 



Traditional 

N=211 


Functional 

N=1030 


Skills 


Total 

N= 


Population 
1239 


Raw Score 


Percentile 


Raw Score 


Percentile 


Raw Score Percentile 


22-25 


99 


30-42 


99 


24-42 


99 


21 


98 


24-26 


98 


23 


98-99 


20 


97 


22-23 


97 


22 


98 


19 


95 


21 


96 


21 


97 


18 


94 


20 


95 


20 


96 


17 


90 


19 


94 


19 


95 


16 


86 


18 


91 


18 


92-93 


15 


79 


17 


88 


17 


89 


14 


70 


16 


85 


16 


86 


13 


57-5 8 


15 


79-80 


15 


80 


12 


43 


14 


73 


14 


73 


11 


32 


13 


64 


13 


64 


10 


22 


12 


54 


12 


53 


9 


13 


11 


42 


11 


4l 


8 


8 


10 


31 


10 


30 


7 


3 


9 


22 


9 


20 


0-6 


1 


8 


13 


8 


9 






7 


6 


7 


6 






6 


3 


6 


3 






0-5 


1 


0-5 


1 



Range 


6-25 


Range 


0-42 


Range 


0-42 


Median 


12 


Median 


11 


Median 


11 


Mode 


14 


Mode 


12 


Mode 


12 


Mean 


13.061 


Mean 


12.478 


Mean 


12.585 


S.D. 


3.322 


S.D. 


7.773 


S.D. 


4.005 



G-2 



PROJECT NORMS, MLA COOPERATIVE CLASSROOM LISTENING TEST 

FRENCH, FORM LA, 2 SEMESTERS 



Traditional Functional Skills Total Population 

N-211 N=1031 N=1242 



Raw Score 


Percentile 


Raw Score Percentile 


Raw Score 


Percentile 


23-25 


99 


30-80 


99 


30-80 




99 


22 


97 


28-29 


98 


29 




98 


21 


95 


27 


97 


27-28 




97 


20 


93 


26 


96 


25-26 




96 


19 


91 


25 


95 


24 




95 


18 


87 


24 


94 


23 




93 


17 


79 


23 


93 


22 




92 


16 


75 


22 


91 


21 




89 


15 


66 


21 


89 


20 




86 


14 


58 


20 


85 


19 




83 


13 


47 


19 


82 


13 




80 


12 


34 


18 


79 


17 




75 


11 


29 


17 


74 


16 




69 


10 


19 


16 


68 


15 




63 


9 


14 


15 


62 


14 




57 


8 


8 


14 


57 


13 




47 


7 


4 


13 


48 


12 




38 


0-6 


1 


12 


39 


11 




30 






11 


31 


10 




22 






10 


23 


9 




15 






9 


16 


8 




9 






8 


10 


7 




4 




- 


7 


4 


6 




2 






6 


3 


0-5 




1 






0-5 


1 








Range 5- 


■25 


Range 0- 


-80 


Range 0- 


-80 




Median 


13 


Median 


13 


Median 


13 




Mode 


13 


Mode 


14 


Mode 


14 




Mean 


13.95 


Mean 


14.62 


Mean 


14. 


64 


S.D. 


4.01 


S.D. 


5.89 


S.D. 


5.65 



G-3 



ERIC 



PROJECT NORMS, MLA 


COOPERATIVE CLASSROOM 


READING TEST 




FRENCH, FORM 


LA, 2 SEMESTERS 






Traditional 


Functional Skills 


Total Population 


N=212 


N= 


1035 


N= 


124? 


Raw Score 


Percentile 


Raw Score Percentile 


Raw Score Percentile 


30-40 


99 


29-43 


99 


30-43 


99 


28-29 


97 


28 


98 


29 


98 


27 


94 


26-27 


97 


27 


97 


26 


92 


25 


96 


26 


96 


24-25 


91 


24 


95 


25 


95 


23 


87 


23 


93 


24 


94 


22 


84 


22 


91 


23 


92 


21 


78 


21 


89 


22 


90 


20 


75 


20 


86 


21 


87 


19 


68 


19 


83 


20 


84 


18 


64 


18 


79 


19 


81 


17 


5^ 


17 


72 


18 


76-77 


16 


46 


16 


65 


17 


69 


15 


35 


15 


56-57 


16 


62 


14 


27 


14 


**5 


15 


53 


13 


24 


13 


36 


14 


42 


12 


17-18 


12 


27 


13 


34 


11 


13 


11 


18 


12 


25 


10 


10 


10 


11 


11 


17 


9 


5 


9 


5 


10 


10 


8 


3 


8 


3 


9 


5 


7 


2 


0-7 


1 


8 


3 


0-6 


1 






0-7 


1 


Range 6- 


40 


Range 


0-43 


Range 


0-43 


Median 


16 


Median 


14 


Median 


14 


Mode 


16 


Mode 


15 


Mode 


15 


Mean 


16.79 


Mean 


16.43 


Mean 


15.80 


S.D. 


6.39 


S.D. 


4.41 


S.D. 


4.20 



PROJECT NORMS, MLA COOPERATIVE CLASSROOM LISTENING TEST 

GERMAN, FORM LA, 2 SEMESTERS 



Traditional 

N=134 



Functional Skills 
N=786 



Total Population 
N-920 



Raw Score Percentile Raw Score Percentile Raw Score Percentile 



34-40 


99 


31-**5 




99 


31-45 


99 


31 


98 


30 




98 


30 


98 


27-30 


97 


28-29 




97 


28-29 


97 


26 


92 


26-27 




96 


27 


96 


25 


91 


25 




94 


26 


95 


23-24 


88 


24 




93 


25 


94 


22 


87 


23 




92 


24 


92 


21 


84 


22 




90 


23 


91 


20 


81 


21 




88 


22 


90 


19 


78 


20 




85 


21 


88 


18 


67 


19 




82 


20 


85 


17 


63 


18 




78 


19 


81 


16 


52 


17 




72 


18 


76 


15 


**5 


16 




66 


17 


70 


14 


38 


15 




57 


16 


64 


13 


32 


14 




49 


15 


55 


12 


26 


13 




40 


14 


48 


11 


17 


12 




30 


13 


39 


10 


9 


11 




22 


12 


30 


9 


5 


10 




14 


11 


21 


0-6 


1 


9 




8 


10 


14 






8 




4 


9 


7 






7 




2 


8 


4 






0-6 




1 


7 


2 












0-6 


1 


Range 


0-40 


Range 


5-^5 




Range 


0-45 


Median 


15 


Median 


14 




Median 


14 


Mode 


17 


Mode 


13 




Mode 


13 


Mean 


16.61 


Mean 


16 . 


11 


Mean 


15.59 


S.D. 


5.80 


S.D. 


2. 


50 


S.D. 


4.77 



G-5 



o 

ERLC 



PROJECT NORMS, MLA COOPERATIVE CLASSROOM READING TEST 

GERMAN, FORM LA, 2 SEMESTERS 



Traditional 

N=135 


Functional 

N=78“5 


. Skills 


Total Population 
N=921 


Raw Score Percentile 


Raw Score 


Percentile 


Raw Score 


Percentile 


34-40 




99 


27-71 


99 


29-71 




99 


29-33 




97 


24-26 


98 


26-28 




98 


28 




96 


23 


97 


24-25 




97 


26-27 




94 


22 


96 


23 




96 


25 




91 


21 


95 


22 




94 


24 




89 


20 


92 


21 




93 


23 




88 


19 


89 


20 




89 


22 




84 


18 


84 


19 




86 


21 




80 


17 


77 


18 




81 


20 




74 


16 


70 


17 




74 


19 




67 


15 


61 


16 




67 


18 




62 


14 


50 


15 




58 


17 




60 


13 


40 


14 




48 


. 16 




50 


12 


29 


13 




38 


15 




41 


11 


21 


12 




28 


14 




34 


10 


13 


11 




20 


13 




27 


9 


7 


10 




13 


12 




22 


8 


4 


9 




6 


11 




14 


7 


2 


8 




4 


10 




13 


0-6 


1 


7 




2 


9 




5 






0-6 




1 


8 




3 












0-7 




2 












Range 


5-40 




Range 0- 


71 


Range 0- 


-71 




Median 


15 




Median 


13 


Median 


14 




Mode 


17 




Mode 


15 


Mode 


15 




Mean 


17. 


16 


Mean 


14.78 


Mean 


15. 


11 


S.D. 


5. 


92 


S.D. 


4.8 


S.D. 


5. 


10 



G-6 



PROJECT NORMS 



FRENCH, FORM LB, 4 SEMESTERS 



Listening. N=475 Reading. N=475 



Raw Score 


Percentile 


Raw Score 


Percentile 


40-41 




99 


45-50 


99 


39 




98 


43-44 


98 


37-38 




97 


42 


97 


36 




96 


40-41 


96 


34-35 




94 


39 


95 


33 




92 


37-38 


94 


32 




89 


36 


92 


31 




87 


35 


91 


30 




85 


33-34 


90 


29 




82 


32 


89 


28 




79 


31 


87 


27 




76 


30 


84 


26 




74 


29 


83 


25 




70 


28 


79 


24 




66 


27 


76 


23 




61 


26 


73 


22 




57 


25 


69 


21 




51 


24 


64 


20 




45 


23 


62 


19 




41 


22 


57 


18 




37 


21 


53 


17 




32 


20 


49 


16 




27 


19 


42 


15 




21 


18 


38 


14 




17 


17 


33 


13 




14 


16 


28 


12 




10 


15 


23 


11 




8 


14 


19 


10 




4 


13 


14 


9 




2 


12 


8 


0-8 




1 


11 


6 








10 


3 








0-9 


1 


Range 3- 


-41 




Range 4< 


-50 


Median 


20 




Median 


20 


Mode 


22 




Mode 


20 


Mean 


21. 


8 


Mean 


22.09 


S.D. 


7. 


59 


S.D. 


8.30 



G-7 




PROJECT NORMS 

GERMAN, FORM LB, 4 SEMESTERS 



Listening, N=548 Reading, N=549 



Raw Score Percentile 


Raw Score Percentile 


41-45 




99 


43-47 




99 


38-39 




98 


41-42 




98 


37 




97 


37-40 




97 


36 




96 


35-36 




96 


35 




95 


34 




95 


34 




94 


33 




94 


33 




93 


32 




92 


32 




91 


31 




91 


31 




90 


30 




89 


30 




87 


29 




88 


29 




86 


27-28 




86 


28 




84 


26 




84 


2-7 




82 


25 




83 


26 




79 


24 




81 


25 




77 


23 




77 


24 




74 


22 




74 


23 




69 


21 




70 


22 




66 


20 




67 


21 




62 


19 




64 


20 




58 


18 




59 


19 




53 


17 




53 


18 




48 


16 




48 


17 




44 


15 




42 


16 




39 


14 




35 


15 




33 


13 




27 


14 




27 


12 




20 


13 




22 


11 




14 


12 




17 


10 




8- 


11 




11 


9 




5 


10 




7 


8 




2 


9 




4 


0-7 




1 


8 




3 








7 




2 








0-6 




1 








Range 


0-45 




Range 


4-47 




Median 


18 




Median 


16 




Mode 


16 




Mode 


l4 




Mean 


19. 


78 


Mean 


18.73 




S.D. 


8. 


40 


S.D. 


7.81 





ERLC 



G-8 



APPENDIX H 



TRANSCRIPTION OF THE DISCUSSION PORTION 
OF THE FINAL EVALUATION MEETING 



TRANSCRIPTION OF THE DISCUSSION PORTION OF THE FINAL EVALUATION 
MEETING. 



On Saturday, May 4 , 1968, the original participating 
teachers, supervisors and Project Staff met for a final 
evaluation meeting at West Chester. A number of original 
participants from the Pittsburgh area attended as well as 
many from eastern Pennsylvania. 

After the results of the second year were presented to 
the group, a general discussion of the conduct of the experi- 
ment was encouraged. Teachers and staff participated freely 
in the exchange. The following pages are a transcription, 
paraphrased at times for brevity, of the discussion. Every 
attempt was made to retain the freedom and flavor of the 
discussion. 



PROJECT 1330 EVALUATION MEETING 
SATURDAY, MAY 4, 1968 



The following Teacher responses were given to the question: 
’’Did the teachers stay within the assigned strategy when the 
observer was not in the class?” 



T ”1 did the same thing in the classroom whether the Observer 
was there or not; I made no special lesson plan.” 

T^ ”1 adhered even when the Observer was not there.” 

Dr. Smith: ”If the teacher was observed deviating from the as- 

signed strategy, he was dropped from the Project.” 

T Felt that ’’Most teachers stayed with the assigned strategy 
3 not only because the Observer was there but also because 
the students would be aware that the teacher was putting 
on a show. Out of respect for himself and his students 
the teacher adhered.” 

Several teachers voiced agreement. 

T. ’’Most teachers were given the strategy they were already 

teaching, therefore they didn’t deviate.” Observer did not 
bother him. 

T "My students may have been more motivated when taking the 
^ tests since these were used as the students’ final exam 
grades. The students made more effort to study for exams 
in May since these counted, whereas tests earlier in the 
year did not count.” 

Several teachers voiced agreement. 

T, "The TLM strategy was not really defined. Was the TLM teach- 
ing that went on not a combination of Direct Method as well 
as everything else?” 

# 

Dr. Roberts: ’’The TLM strategy was defined.” 

Dr. Smith: "John Carroll suggested a second traditional or 

’’Modified Traditional” group.” 

Mrs. Allen: ”TLM teachers had manuals.” 

Mr. Baranyi: "Do you feel that TLM category was too broad? 

Not well enough defined.” 

Several teachers voiced disagreement. 



erIc 



H-2 



"My understanding of the TLM strategy called for a minimum 
of foreign language; translation; and vocabulary lists." 

Tg "The students were not encouraged in any way to converse 
in the foreign language. The only time they spoke in the 
foreign language was when they read." 

Mr. Eisenstadt: "Teachers were handicapped by TLM rules. Some 

of my teachers complained about this. T /> most 
cases the teachers adhered rather well to the 
guidelines. " 

Dr. Roberts: "The Consultants talked of good and bad traditional. 

They were asked to set up a good traditional 
philosophy. The criteria were based on this 
philosophy. The basic philosophy, attitude and 
viewpoint for each strategy was developed from this 
conference. Fundamental guidelines and criteria 
. ‘'or each strategy were developed from these basic 
philosophical viewpoints." 

Mr. Berger: It is often said that good teaching is poor research 

and good research is poor teaching. An • eclectic* 
approach is probably best even in the most advanced 
audio-lingual approach, i.e. the teacher will take 
the best of several teaching approaches and adapt 
them. But, the Project asked teachers to give 20$ 
of their teaching time, even if it conflicted with 
their view of good teaching. The 'experts' however, 
did agree to this strategy, I doubt therefore that 
it would have been poor teaching." 

Dr. Smith: "Teachers' guidelines were so detailed that we have 

received requests for these as well." 

T "Is there a record of teachers who dropped out of the Project 
at the end of one and two years and their reasons?" 

"I felt fortunate to hav* been placed into the FSG group 
because this method is the best. How the teachers felt will 
be reflected in the student. For example, to teach TLM if 
the teacher did not feel this was the best way. The teacher's 
attitude plays a large role." 

Several teachers voiced agreement:. 

"If the teacher was assigned a strategy that she agreed with 
she could teach differently than if she did not believe in 

it." 

"Teachers brought their attitudes with them. Would this 
affect the new strategy in any way?" 

. Smith: "Most were in the strategy they liked." 



T 
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T 



11 



T 



12 



Several teachers voiced agreement and disagreement regarding 
choice of strategy. 

H-3 



Dr. Roberts: "Anyone thinking he had a choice happened to get 

the strategy that he liked . " 

Mr. Berger: "There was no random assignment for TLM strategy; 

if no record positions were available AA lab was 
assigned; there was a choice, at times, with AR 
labs. " 

"Are there statistics of teachers who were assigned a 
strategy which displeased them? Was there anyone that 
taught this way?" 

"I taught a method which I didr. 't like nor thought suc- 
cessful. That is the reason I didn't continue with 2nd 
year. The students in that class were far behind others." 

"When I started the assigned strategy I did not like it, 
at the end, however I did. My bitterness in the beginning 
may have had some effect on the students, at least in the 
first few months." 

Dr. Smith: "Teachers' Opinion Scales indicated that at the end 

of 2 years - the kids were dull and not interested, 
but the teachers were still interesting and exciting 

^l6 random assignment of strategies is a real situation; 

i.e. teachers are often told what to teach when they come 
to a new district." 

"Results may have been different had every teacher taught 
( the strategy that he liked." 

^18 Ott) : "The teacher will use what he thinks is most 

important regardless of the textbook. " 

^19 "^ ere was ways of adapting a traditional text." 

T£q "I liked the method (TLM), the students did also and they 
worked hard because they were in the Project." 

Tp^ "I taught FSM, even though I would not use it solely; I 

tried to adhere. After a year I didn't feel FSM was inef- 
fective and became to like it. It gave me the opportunity 
for much testing. Students were not penaliL 1 for not 
having grammar." 

^22 "^ len grammar is included, not only by analogy but analysis 
students feel more secure and are happier. In the long run 
they get to appriciate language better." 




Teachers were asked to respond to the following question: 

"Why did teachers drop out of the Project?" 

Teachers deviated and were dropped. 

Schools dropped out of Project. 

Many students graduated. 

Teacher responses: 

T "Would have involved switching from one school building to 
another. " 

T "The district had no results of previous research and were 
afraid this would again happen." 

T^ "School District was involved in merger of 9 districts." 

T^ "Left the district, new district did not want to bother." 

T^ "Didn't feel her students were achieving satisfactorily." 

T^ "Switched schools and became a replicating Project teacher." 

T^ "Was on Sabbatical." 

T p "Felt they were dropped because lab was always out of oper- 
b ation." 

T "I played down the Project; perhaps students reacted nega- 
' tively. I did not make them feel they were special." 

T Project class was not to be something special." 
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"We were told not to tell the students. Why do students 
develop this attitude?" 

T "The problem came with second year students. Some were fol- 
1 lowed, others in same class were not." 

T "The number of tests we gave caused students to ask 'Does it 
** count?' 'What are the results?' 'Where do I stand?' If 
we test and don't tell them results, this is not normal." 

Mr. Baranyi: "Could not the tests be made a part of the actual 

school work?" 
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"Impossible; students will discuss this." 

"Some students did not know there was a Project." 

"In spite of playing it down, students felt they were 
being treated differently." 
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T 7 "In three years you cannot keep it down. I had to tell 
' students that these tests did not count. Students now 
like to take these tests; have different attitudes." 

Dr. Roberts: "At Workshops teachers were told classes, students 

were not to be considered 'special* sc as not to 
influence results." 

Mrs. Sandstrom: "Where do we go from here? What impact will 

this Project have on administrators. Eg. after 
Keating Report - for 5 years no language labs. 

This report will aid those opponents of language 
labs. It could paralyze the foreign language 
field unless there are factors for recommendations 
accompanying the Report." 

Dr. Smith: "We must report the facts as we found them." 

To "If tapes used were canned programs and same as those used 
in class - then the Project is not a valid evaluation of 
language labs." 

Dr. Smith: "The lab is a place to practice what has already 

been learned." 

T 1Q "The most important element is the human element; if the 
' teacher is liked or not liked by the students." 

Several teachers voiced agreement. 

T^o "Was there a distinction made in the original groups be- 
tween language labs and the electronic classroom." 

Dr. Smith: "No, although TR, AA, AR labs were identified and lab 

strategies outlined." 

Dr. Smith: "The 2nd year report is being compiled; it will be 

available to all." 

Mr. Berger: "Encouraged by the interest, discussion and questions 

raised by Project teachers." 



